-- Logs begin at Tue 2022-09-27 15:41:39 UTC, end at Tue 2022-09-27 16:55:23 UTC. -- Sep 27 16:27:09.130544 dv-cinder-855060-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 27 16:27:09.139626 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 27 16:27:09.141617 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 27 16:27:09 2022] *** Sep 27 16:27:09.141617 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 27 16:27:09.141617 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 27 16:27:09.141617 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: nodename: dv-cinder-855060-2-iscsi Sep 27 16:27:09.141617 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: machine: x86_64 Sep 27 16:27:09.141617 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: clock source: unix Sep 27 16:27:09.141617 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: pcre jit disabled Sep 27 16:27:09.141617 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: detected number of CPU cores: 4 Sep 27 16:27:09.141617 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: current working directory: / Sep 27 16:27:09.141617 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: detected binary path: /usr/bin/uwsgi-core Sep 27 16:27:09.142296 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: your processes number limit is 47680 Sep 27 16:27:09.142296 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: your memory page size is 4096 bytes Sep 27 16:27:09.142296 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: detected max file descriptor number: 2048 Sep 27 16:27:09.142296 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: lock engine: pthread robust mutexes Sep 27 16:27:09.142296 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: thunder lock: enabled Sep 27 16:27:09.142296 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 27 16:27:09.142296 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 27 16:27:09.181799 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: Python main interpreter initialized at 0x557daad289c0 Sep 27 16:27:09.181799 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: python threads support enabled Sep 27 16:27:09.181799 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: your server socket listen backlog is limited to 100 connections Sep 27 16:27:09.181799 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: your mercy for graceful operations on workers is 90 seconds Sep 27 16:27:09.182157 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: mapped 403077 bytes (393 KB) for 2 cores Sep 27 16:27:09.182232 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: *** Operational MODE: preforking *** Sep 27 16:27:09.182448 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: *** uWSGI is running in multiple interpreter mode *** Sep 27 16:27:09.182448 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: spawned uWSGI master process (pid: 106075) Sep 27 16:27:09.182632 dv-cinder-855060-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 27 16:27:09.183276 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: spawned uWSGI worker 1 (pid: 106076, cores: 1) Sep 27 16:27:09.183603 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: spawned uWSGI worker 2 (pid: 106077, cores: 1) Sep 27 16:27:09.183766 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 27 16:27:09.858991 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 27 16:27:09.863368 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 27 16:27:11.042782 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 16:27:11.042782 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: from cryptography.utils import int_from_bytes Sep 27 16:27:11.043386 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 16:27:11.043386 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: from cryptography.utils import int_from_bytes Sep 27 16:27:11.053781 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 16:27:11.053781 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: from cryptography.utils import int_from_bytes Sep 27 16:27:11.054206 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 16:27:11.054206 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: from cryptography.utils import int_from_bytes Sep 27 16:27:13.555622 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 27 16:27:13.556173 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 27 16:27:13.556387 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 27 16:27:13.556746 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 27 16:27:13.557001 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 27 16:27:13.557386 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.557706 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.558025 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.558338 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.558609 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 27 16:27:13.559007 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.559097 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 27 16:27:13.559184 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.559294 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.559422 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 27 16:27:13.559604 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.559785 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 27 16:27:13.559926 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.560040 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 27 16:27:13.560182 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.560680 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.560767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.561005 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.561101 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855060-2-iscsi {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.561324 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.561417 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.561640 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.561734 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.561944 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.562030 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.562257 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.562342 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.562574 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.562720 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.562897 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.562994 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.563198 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.563283 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.563470 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.563706 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.563838 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.564843 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855060-2-iscsi {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.564945 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.565018 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.565084 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.565162 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.565240 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.565317 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.565390 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.565455 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.565519 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.565599 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.565673 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.565896 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.566032 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.566183 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.566277 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.566518 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.566672 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.566841 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.567007 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.567234 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855060-2-iscsi {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.567322 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.567547 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.567642 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.567855 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.567954 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.568168 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.568266 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.568518 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.568620 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.568842 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.568937 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.569148 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.569233 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.569460 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.569554 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.569764 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.569849 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.570067 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.570162 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855060-2-iscsi {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.570947 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.571101 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.571345 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.571434 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.571645 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.571739 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.572055 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.572141 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.572352 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.572435 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.572656 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.572791 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.572957 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.573042 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.573274 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.573368 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.573580 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.573712 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.573882 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.573981 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.574127 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.574227 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.574431 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.574525 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.574754 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.574882 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.575093 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.575204 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.575411 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.575509 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.575660 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.575768 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.575906 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.576023 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.576218 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.576328 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.576534 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.576621 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.576838 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.576924 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.577140 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.577225 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.577441 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.577537 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.577744 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.577841 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.578043 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.578136 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.578326 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.578428 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.578578 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.578665 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.578922 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.579013 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.579238 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.579336 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.579544 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.579636 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.579852 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.579936 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.580152 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.580237 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.580456 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.580547 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.580763 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.580847 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.581068 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.581161 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.581370 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.581455 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.581673 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.581762 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.581991 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.582084 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.582301 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.582385 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.582614 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.582709 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.582955 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.583043 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.583259 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.583390 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.583559 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.583796 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.583905 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.584044 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.584161 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.584356 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.584487 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.584696 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.584790 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.585019 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.585132 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.585309 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.585401 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.585606 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.585693 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.585916 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.586019 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.586913 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.587012 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.587320 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.587407 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.587637 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.587721 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.587964 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.588049 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.588265 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.588397 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.588569 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.588655 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.588835 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.588928 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.589139 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.589237 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.589443 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.589534 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.589742 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.589881 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.590068 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.590201 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.590339 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.590424 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.590638 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.590732 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.590961 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.591061 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.591267 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.591352 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.591574 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.591672 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.591874 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.591959 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.592177 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.592260 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.592517 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.592619 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.592773 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.592860 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.593072 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.593165 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.593369 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.593462 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.593667 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.593760 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.593968 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.594055 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.594269 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.594361 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.594566 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.594651 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.594898 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.595003 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.595202 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.595301 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.595500 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.595593 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.595807 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.595893 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.596097 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.596183 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.596395 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.596480 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.596705 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.596798 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.597004 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.597092 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.597302 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.597394 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.597597 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.597689 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.597891 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.597978 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.598186 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.598277 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.598484 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.598576 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.598790 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.598880 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.599094 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.599180 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.599386 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.599484 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.599696 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.599781 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.600007 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.600092 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.600305 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.600398 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.600604 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.600690 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.600902 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.600987 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.601202 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.601295 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.601506 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.601599 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.601835 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.602023 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.602224 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.602371 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.602467 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.602682 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.602768 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.603041 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.603173 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.603344 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.603429 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.603648 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.603734 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.603950 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.604048 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.604258 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.604343 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:27:13.604577 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.604664 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.604885 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.605047 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.605190 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.605331 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.605496 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.605581 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.605805 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.605900 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.606116 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.606210 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.606437 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.606522 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.606747 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.606873 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.607080 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.607165 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.607391 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.607487 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.607694 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.607789 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.608002 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.608086 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.608315 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.608408 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.608624 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.608710 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.608926 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.609018 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.609252 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.609336 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.609566 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.609652 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.609881 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.609974 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.610198 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.610282 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.610503 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.610588 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.610825 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.610915 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.611134 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.611223 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.611439 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.611534 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.611759 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.611843 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.612072 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.612166 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.612381 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.612474 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.612695 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.612780 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.613001 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.613101 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.613319 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.613404 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.613626 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.613711 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.613931 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.614025 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.614236 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.614323 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.614539 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.614623 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.614868 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.614969 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.615199 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.615283 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.615508 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.615592 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.615817 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.615910 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.616125 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.616210 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.616432 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.616517 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.616737 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.616822 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.617040 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.617124 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.617371 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.617597 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.617695 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.617775 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.618003 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.618088 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.618317 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.618406 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.618640 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.618727 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.618970 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.619068 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.619274 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.619368 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.619588 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.619674 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.619898 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.619987 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.620197 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.620290 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.620504 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.620589 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.620807 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.620900 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.621109 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.621203 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.621411 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.621497 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.621727 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.621860 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.622010 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.622105 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.622320 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.622406 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.622623 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.622709 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.622947 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.623049 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.623267 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.623355 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.623568 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.623663 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.623865 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.623957 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.624175 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.624260 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.624473 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.624565 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.624772 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.624859 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.625078 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.625168 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.625382 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.625466 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.625682 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.625767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.625984 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.626069 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.626287 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.626382 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.626593 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.626679 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.626918 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.627007 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.627222 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.627388 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.627527 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.627619 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.627840 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.627927 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.628149 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.628254 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.628457 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.628541 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.628768 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.628855 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.629076 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.629172 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.629374 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.629467 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.629676 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.629767 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.629973 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.630061 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.630269 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.630361 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.630564 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.630656 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.630889 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.630991 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.631188 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.631275 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.631484 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.631569 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.631779 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.631866 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.632080 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.632165 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.632374 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.632460 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.632686 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.632774 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.633549 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.633652 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.633858 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.633944 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.634173 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.634261 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.634475 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.634560 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.634805 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.634908 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.635106 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.635193 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.635409 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.635495 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.635710 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.635805 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.636032 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.636128 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.636340 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.636434 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.636642 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.636737 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.636947 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.637040 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.637251 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.637336 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.637554 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.637647 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.637861 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.637948 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.638163 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.638250 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.638476 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.638564 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.638819 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.638957 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.639115 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.639213 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.639420 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.639514 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.639738 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.639831 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.640043 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.640129 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.640354 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.640441 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.640653 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.640740 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.640958 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.641042 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.641279 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.641367 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.641592 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.641678 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.641905 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.641998 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.642212 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.642296 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.642514 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.642599 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.642847 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.642954 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.643154 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.643241 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.643455 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.643541 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.643757 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.643856 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.644073 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.644161 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.644372 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.644459 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.644673 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.644772 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.644984 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.645078 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.645285 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.645378 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.645599 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.645699 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.645903 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.645996 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.646211 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.646304 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.646507 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.646600 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.646835 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.646936 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.647154 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.647238 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.647463 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.647551 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.647767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.647852 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.648071 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.648165 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.648386 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.648498 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.648800 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.648891 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.649107 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.649196 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.649414 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.649501 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.649712 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.649808 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.650012 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.650106 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.650316 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.650432 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.650625 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.650744 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.650954 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.651082 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.651259 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.651402 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.651556 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.651713 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.651870 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.652023 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.652171 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.652337 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.652468 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.652642 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.652766 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.652948 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.653070 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.653257 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.653384 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.653572 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.653692 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.653882 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.654006 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.654198 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.654320 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.654504 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.654618 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.654842 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.654933 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.655154 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.655240 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.655459 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.655566 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.655765 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.655903 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.656077 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.656163 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.656395 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.656567 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.656704 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.656789 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.657026 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.657114 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.657326 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.657413 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.657637 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.657721 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.657941 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.658027 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.658245 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.658332 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.658556 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.658641 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.658881 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.658968 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.659189 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.659277 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.659492 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.659587 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.659798 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.659882 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.660104 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.660191 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.660410 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.660496 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.660714 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.660808 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.661020 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.661107 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.661326 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.661413 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.661643 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.661736 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.661952 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.662046 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.662258 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.662347 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.662563 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.662663 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.662886 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.662975 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.663194 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.663279 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.663506 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.663604 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.663845 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.664068 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.664699 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.665016 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.665136 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.665343 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.665469 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.665650 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.665773 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.665959 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.666119 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.666268 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.666438 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.666573 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.666768 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.666904 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.667121 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.667217 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.667433 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.667738 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.667823 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.668047 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.668134 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.668351 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.668447 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.668652 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.668738 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.668960 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.669047 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.669262 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.669362 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.669562 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.669658 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.669862 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.669978 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.670167 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.670297 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.670467 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.670608 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.670765 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.670951 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.671086 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.671263 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.671385 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.671572 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.671695 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.671887 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.671981 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.672199 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.672286 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.672506 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.672593 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.672812 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.672910 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.673125 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.673219 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.673430 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.673518 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.673736 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.673836 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.674032 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.674120 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.674335 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.674420 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.674653 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.674748 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.674984 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.675084 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.675298 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.675392 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.675602 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.675697 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.675925 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.676049 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.676224 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.676310 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.676526 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.676648 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.676829 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.676915 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.677126 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.677218 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.677425 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.677512 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.677731 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.677818 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.678035 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.678121 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.678333 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.678420 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.678637 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.678724 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.678964 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.679065 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.679270 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.679365 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.679574 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.679660 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.680488 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.680633 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.680791 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.680877 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.681091 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.681178 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.681402 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.681565 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.681708 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.681835 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.682005 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.682091 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.682305 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.682404 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.682610 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.682696 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.682944 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.683034 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.683246 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.683335 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.683548 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.683633 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.683845 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.683929 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.684155 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.684250 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.684452 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.684538 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.684749 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.684837 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.685046 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.685516 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.685609 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.685832 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.685918 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.686145 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.686241 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.686455 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.686543 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.686759 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.686882 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.687084 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.687178 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.687382 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.687469 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.687685 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.687770 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.687982 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.688069 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.688279 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.688365 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.688581 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.688668 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.688889 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.689017 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.689198 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.689283 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.689496 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.689582 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.689800 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.689888 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.690098 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.690192 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.690398 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.690501 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.690694 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.690799 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.691020 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.691107 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.691317 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.691416 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.691614 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.691708 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.691911 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.692005 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.692214 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.692312 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.692511 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.692598 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.692827 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.692911 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.693125 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.693219 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.693423 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.693510 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.693721 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.693816 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.694017 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.694141 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.694331 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.694418 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.694637 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.694724 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.694969 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.695102 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.695276 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.695389 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.696110 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.696225 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.696518 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.696605 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.696842 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.696934 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.697155 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.697272 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.697460 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.697556 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.697756 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.697848 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.698058 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.698156 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.698362 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.698447 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.698668 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.698753 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.698994 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.699137 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.699295 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.699382 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.699610 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.699695 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.699916 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.700011 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.700222 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.700314 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.700535 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.700625 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.700851 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.700949 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.701155 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.701241 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.701452 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.701551 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.701757 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.701852 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.702064 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.702150 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.702364 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.702450 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.702661 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.702748 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.702988 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.703083 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.703294 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.703380 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.703599 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.703686 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.703902 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.703988 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.704206 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.704298 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.704508 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.704615 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.704806 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.704904 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.705108 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.705195 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.705411 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.705499 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.705709 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.705795 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.706015 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.706108 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.706319 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.706404 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.706618 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.706710 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.706945 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.707046 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.707245 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.707332 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.707549 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.707642 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.707848 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.707941 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.708147 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.708265 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.708457 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.708569 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.708767 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.708862 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.709071 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.709202 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.709392 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.709479 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.709702 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.709789 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.710005 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.710091 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.710315 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.710400 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.710616 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.710703 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.710949 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.711670 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.711871 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.711991 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.712300 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.712473 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.712607 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.712793 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.712906 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.713108 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.713203 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.713417 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.713504 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.713731 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.713817 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.714044 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.714131 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.714364 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.714450 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.714660 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.714745 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.715003 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.715090 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.715302 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.715422 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.715621 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.715737 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.716033 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.716121 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.716340 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.716465 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.716640 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.716727 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.716942 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.717035 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.717253 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.717338 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.717577 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.717671 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.717880 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.717967 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.718226 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.718310 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.718544 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.718683 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.718876 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.718968 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.719185 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.719317 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.719487 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.719603 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.719804 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.719905 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.720117 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.720204 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.720419 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.720505 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.720726 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.720899 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.721024 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.721211 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.721338 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.721522 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.721653 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.721844 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.721964 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.722165 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.722277 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.722489 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.722683 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.722807 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.723027 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.723114 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.723334 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.723422 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.723650 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.723739 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.723970 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.724056 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.724269 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.724355 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.724567 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.724655 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.724871 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.724958 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.725171 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.725266 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.725471 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.725562 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.725787 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.725875 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.726086 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.726185 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.726391 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.726545 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.726816 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.727140 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.727275 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.727442 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.727532 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.727741 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.727829 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.728057 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.728143 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.728357 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.728454 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.728663 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.728748 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.728968 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.729054 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.729272 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.729398 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.729578 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.729664 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.729877 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.729970 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.730190 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.730275 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.730493 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.730588 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.730812 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.730943 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.731114 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.731206 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.731415 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.731509 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.731719 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.731815 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.732042 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.732128 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.732347 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.732446 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.732671 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.732765 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.732982 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.733067 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.733288 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.733383 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.733610 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.733698 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.733913 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.734006 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.734230 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.734317 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.734536 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.734625 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.734864 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.734964 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.735174 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.735261 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.735470 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.735557 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.735768 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.735862 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.736072 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.736158 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.736372 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.736467 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.736672 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.736759 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.736971 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.737071 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.737275 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.737369 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.737571 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.737658 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.737868 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.737963 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.738168 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.738255 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.738484 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.738571 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.738831 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.738935 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.739119 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.739206 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.739424 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.739511 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.739722 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.739817 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.740021 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.740114 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.740318 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.740412 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.740644 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.740737 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.740942 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.741035 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.741249 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.741334 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.741553 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.741650 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.741854 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.741939 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.742156 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.742268 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.742507 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.742614 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.742830 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.742934 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.743141 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.743227 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.743449 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.743544 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.743754 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.743841 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.744059 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.744159 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.744359 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.744446 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.744671 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.744756 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.744980 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.745075 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.745294 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.745381 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.745601 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.745802 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.745924 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.746127 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.746241 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.746435 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.746557 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.746745 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.746885 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.747078 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.747199 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.747386 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.747515 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.747694 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.747831 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.748001 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.748144 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.748307 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.748455 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.748626 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.748770 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.748921 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.749083 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.749247 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.749402 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.749561 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.749880 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.749966 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.750209 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.750297 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.750522 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.750684 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.750858 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.750949 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.751173 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.751271 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.751483 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.751588 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.751795 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.751888 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.752107 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.752194 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.752419 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.752507 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.752726 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.752859 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.753033 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.753119 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.753342 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.753437 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.753649 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.753744 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.753954 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.754041 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.754265 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.754352 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.754576 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.754662 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.754905 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.755007 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.755212 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.755299 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.755523 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.755610 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.755834 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.755928 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.756156 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.756242 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.756485 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.756569 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.756798 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.756928 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.757107 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.757193 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.757417 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.757504 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.757729 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.757816 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.758591 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.758764 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.758941 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.759102 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.759261 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.759431 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.759576 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.759750 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.759889 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.760072 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.760206 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.760383 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.760522 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.760696 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.760852 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.761017 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.761190 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.761320 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.761511 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.761605 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.761828 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.761924 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.762144 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.762231 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.762459 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.762553 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.762822 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.763134 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.763224 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.763435 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.763521 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.763748 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.763918 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.764052 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.764256 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.764577 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.764664 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.764916 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.765010 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.765229 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.765425 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.765551 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.765839 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.765936 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.766155 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.766243 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.766462 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.766553 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.766791 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.766922 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.767109 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.767208 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.767413 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.767507 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.767725 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.767971 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.768069 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.768293 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.768379 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.768603 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.768697 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.768909 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.768997 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.769213 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.769299 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.769513 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.769748 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.769838 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.770097 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.770184 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.770418 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.770511 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.770716 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.770837 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.771043 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.771129 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.771343 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.771437 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.771649 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.771743 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.771949 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.772041 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.772254 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.772340 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.772554 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.772642 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.772855 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.772949 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.773163 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.773255 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.773462 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.773591 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.774318 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.774403 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.774632 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.774718 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.774971 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.775105 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.775278 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.775364 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.775596 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.775691 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.775902 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.775989 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.776218 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.776302 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.776520 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.776620 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.776821 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.776907 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.777125 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.777210 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.777431 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.777524 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.777734 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.777820 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.778039 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.778125 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.778345 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.778442 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.778647 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.778732 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.778985 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.779075 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.779293 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.779516 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.779604 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.779847 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.779977 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.780166 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.780261 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.780495 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.780589 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.780822 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.780910 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.781125 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.781289 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.781425 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.781511 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.781724 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.781810 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.782029 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.782127 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.782345 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.782431 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.782654 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.782746 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.782986 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.783078 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.783293 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.783379 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.783598 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.783683 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.783903 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.783998 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.784209 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.784295 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.784516 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.784760 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.784856 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.785110 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.785196 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.785413 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.785499 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.785716 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.785810 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.786019 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.786131 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.786325 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.786439 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.786634 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.786744 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.786993 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.787085 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.787308 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.787395 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.787621 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.787708 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.787931 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.788016 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.788243 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.788328 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.788548 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.788635 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.788851 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.788937 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.789194 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.789292 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.789517 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.789603 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.789829 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.789915 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.790154 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.790257 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.790461 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.790546 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.790760 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.790912 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.791095 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.791408 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.791503 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.791717 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.791803 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.792031 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.792126 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.792352 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.792437 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.792660 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.792753 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.792976 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.793075 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.793289 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.793378 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.793593 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.793678 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.793903 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.794001 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.794205 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.794291 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.794512 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.794597 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.794842 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.794982 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.795229 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.795386 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.795741 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.796114 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.796215 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.796420 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.796508 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.796723 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.796809 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.797031 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.797349 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.797443 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.797654 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.797742 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.797955 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.798041 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.798253 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.798344 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.798560 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.798647 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.798889 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.798992 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.799190 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.799277 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.799490 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.799575 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.799789 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.799884 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.800094 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.800180 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.800393 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.800578 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.800693 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.800925 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.801025 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.801257 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.801344 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.801596 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.801704 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.801900 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.802003 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.802213 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.802301 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.802514 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.802609 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.802839 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.802931 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.803142 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.803237 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.803443 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.803543 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.803742 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.803828 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.804072 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.804165 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.804398 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.804494 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.804710 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.804816 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.805066 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.805158 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.805375 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.805475 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.805691 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.805785 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.805998 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.806094 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.806316 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.806404 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.806618 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.806703 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.806960 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.807047 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.807269 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.807370 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.807598 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.807691 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.807902 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.807996 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.808209 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.808305 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.808517 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.808603 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.808823 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.808918 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.809129 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.809217 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.809436 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.809530 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.809749 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.809843 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.810072 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.810170 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.810665 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.810753 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.811013 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.811188 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.811327 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.811462 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.811644 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.811854 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.811956 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.812192 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.812280 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.812505 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.812592 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.812851 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.812962 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.813190 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.813277 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.813497 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.813591 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.813803 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.813904 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.814110 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.814205 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.814420 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.814508 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.814727 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.814851 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.815080 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.815175 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.815471 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.815572 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.815715 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.815803 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.816036 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.816130 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.816359 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.816452 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.816662 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.816751 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.817015 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.817109 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.817341 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.817428 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.817737 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.817843 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.818047 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.818169 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.818387 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.818518 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.818714 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.818937 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.819038 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.819271 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.819358 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.819633 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.819723 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.819874 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 27 16:27:13.820104 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.820940 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.821355 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.821790 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.822135 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.822453 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.822806 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.823199 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.823521 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.823852 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.824297 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.824615 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.824984 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.825386 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.825778 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.826116 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.826463 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.826821 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.827142 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.827472 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.827848 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:27:13.828116 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 27 16:27:13.976324 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO dbcounter [None req-e4a2ed1b-c177-46dd-8f52-e90158e97d77 None None] Registered counter for database nova_api Sep 27 16:27:13.983951 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO dbcounter [None req-aa6cc55a-89fd-4ac3-9268-bf144970e63b None None] Registered counter for database nova_api Sep 27 16:27:13.997628 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG oslo_db.sqlalchemy.engines [None req-e4a2ed1b-c177-46dd-8f52-e90158e97d77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106076) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 16:27:14.004357 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writer thread running {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 16:27:14.004497 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_db.sqlalchemy.engines [None req-aa6cc55a-89fd-4ac3-9268-bf144970e63b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106077) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 16:27:14.011073 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writer thread running {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 16:27:14.061496 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.context [None req-e4a2ed1b-c177-46dd-8f52-e90158e97d77 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0c749112-4e30-414e-83db-5e002ec73710(cell1) {{(pid=106076) load_cells /opt/stack/nova/nova/context.py:464}} Sep 27 16:27:14.065390 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-e4a2ed1b-c177-46dd-8f52-e90158e97d77 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:27:14.065854 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-e4a2ed1b-c177-46dd-8f52-e90158e97d77 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:27:14.067437 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-e4a2ed1b-c177-46dd-8f52-e90158e97d77 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:27:14.068099 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.context [None req-aa6cc55a-89fd-4ac3-9268-bf144970e63b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0c749112-4e30-414e-83db-5e002ec73710(cell1) {{(pid=106077) load_cells /opt/stack/nova/nova/context.py:464}} Sep 27 16:27:14.068197 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-e4a2ed1b-c177-46dd-8f52-e90158e97d77 None None] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:27:14.068576 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-e4a2ed1b-c177-46dd-8f52-e90158e97d77 None None] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:27:14.070576 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG oslo_concurrency.lockutils [None req-e4a2ed1b-c177-46dd-8f52-e90158e97d77 None None] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:27:14.071994 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-aa6cc55a-89fd-4ac3-9268-bf144970e63b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:27:14.072468 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-aa6cc55a-89fd-4ac3-9268-bf144970e63b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:27:14.072559 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO dbcounter [None req-e4a2ed1b-c177-46dd-8f52-e90158e97d77 None None] Registered counter for database nova_cell0 Sep 27 16:27:14.074015 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-aa6cc55a-89fd-4ac3-9268-bf144970e63b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:27:14.074735 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-aa6cc55a-89fd-4ac3-9268-bf144970e63b None None] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:27:14.075204 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-aa6cc55a-89fd-4ac3-9268-bf144970e63b None None] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:27:14.076579 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO dbcounter [None req-e4a2ed1b-c177-46dd-8f52-e90158e97d77 None None] Registered counter for database nova_cell1 Sep 27 16:27:14.077161 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-aa6cc55a-89fd-4ac3-9268-bf144970e63b None None] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:27:14.079156 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO dbcounter [None req-aa6cc55a-89fd-4ac3-9268-bf144970e63b None None] Registered counter for database nova_cell0 Sep 27 16:27:14.083177 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO dbcounter [None req-aa6cc55a-89fd-4ac3-9268-bf144970e63b None None] Registered counter for database nova_cell1 Sep 27 16:27:14.084448 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG oslo_db.sqlalchemy.engines [None req-e4a2ed1b-c177-46dd-8f52-e90158e97d77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106076) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 16:27:14.087929 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG oslo_db.sqlalchemy.engines [None req-e4a2ed1b-c177-46dd-8f52-e90158e97d77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106076) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 16:27:14.090982 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_db.sqlalchemy.engines [None req-aa6cc55a-89fd-4ac3-9268-bf144970e63b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106077) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 16:27:14.092681 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writer thread running {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 16:27:14.092863 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_db.sqlalchemy.engines [None req-aa6cc55a-89fd-4ac3-9268-bf144970e63b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106077) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 16:27:14.097765 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writer thread running {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 16:27:14.098912 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writer thread running {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 16:27:14.100377 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writer thread running {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 16:27:14.240119 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO dbcounter [None req-e4a2ed1b-c177-46dd-8f52-e90158e97d77 None None] Registered counter for database nova_cell0 Sep 27 16:27:14.245521 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO dbcounter [None req-aa6cc55a-89fd-4ac3-9268-bf144970e63b None None] Registered counter for database nova_cell0 Sep 27 16:27:14.251578 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG oslo_db.sqlalchemy.engines [None req-e4a2ed1b-c177-46dd-8f52-e90158e97d77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106076) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 16:27:14.254845 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_db.sqlalchemy.engines [None req-aa6cc55a-89fd-4ac3-9268-bf144970e63b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106077) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 16:27:14.257281 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writer thread running {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 16:27:14.260105 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writer thread running {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 16:27:14.714831 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: WARNING keystonemiddleware.auth_token [None req-e4a2ed1b-c177-46dd-8f52-e90158e97d77 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 16:27:14.722309 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: WARNING keystonemiddleware.auth_token [None req-e4a2ed1b-c177-46dd-8f52-e90158e97d77 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 16:27:14.728413 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: WARNING keystonemiddleware.auth_token [None req-aa6cc55a-89fd-4ac3-9268-bf144970e63b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 16:27:14.735631 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: WARNING keystonemiddleware.auth_token [None req-aa6cc55a-89fd-4ac3-9268-bf144970e63b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 16:27:15.078001 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: WARNING keystonemiddleware.auth_token [None req-e4a2ed1b-c177-46dd-8f52-e90158e97d77 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 16:27:15.080689 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: WARNING keystonemiddleware.auth_token [None req-aa6cc55a-89fd-4ac3-9268-bf144970e63b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 16:27:15.083915 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: WARNING keystonemiddleware.auth_token [None req-e4a2ed1b-c177-46dd-8f52-e90158e97d77 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 16:27:15.087448 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: WARNING keystonemiddleware.auth_token [None req-aa6cc55a-89fd-4ac3-9268-bf144970e63b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 16:27:15.090292 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557daad289c0 pid: 106076 (default app) Sep 27 16:27:15.092400 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-e4a2ed1b-c177-46dd-8f52-e90158e97d77 None None] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:27:15.092641 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557daad289c0 pid: 106077 (default app) Sep 27 16:27:15.093587 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-e4a2ed1b-c177-46dd-8f52-e90158e97d77 None None] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001743 Sep 27 16:27:15.094006 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 788 bytes} [Tue Sep 27 16:27:15 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:28:40.500168 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-aa6cc55a-89fd-4ac3-9268-bf144970e63b None None] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:28:40.501423 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-aa6cc55a-89fd-4ac3-9268-bf144970e63b None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001955 Sep 27 16:28:40.501692 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 931 bytes} [Tue Sep 27 16:28:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:28:40.518810 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writing DB stats nova_api:SELECT=3 {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:40.526439 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writing DB stats nova_cell1:SELECT=3 {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:40.526439 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writing DB stats nova_cell0:SELECT=3 {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:40.526439 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:41.399971 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-6ae561e4-58ae-4745-ba7c-b4a2ce392c33 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:28:41.431768 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-6ae561e4-58ae-4745-ba7c-b4a2ce392c33 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.923002 Sep 27 16:28:41.432849 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 2/3] 10.222.0.64 () {60 vars in 1292 bytes} [Tue Sep 27 16:28:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:28:44.061831 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-aa6cc55a-89fd-4ac3-9268-bf144970e63b None None] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:28:44.062896 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-aa6cc55a-89fd-4ac3-9268-bf144970e63b None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 27 16:28:44.067100 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 2/4] 10.222.0.64 () {54 vars in 931 bytes} [Tue Sep 27 16:28:44 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:28:44.515446 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-89069581-7d5a-4dba-9e74-a933afb82d00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "id": "c1", "ram": 256}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:28:44.607347 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-89069581-7d5a-4dba-9e74-a933afb82d00 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.536895 Sep 27 16:28:44.607935 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 3/5] 10.222.0.64 () {64 vars in 1283 bytes} [Tue Sep 27 16:28:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 16:28:44.622362 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writing DB stats nova_api:SELECT=3 {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:44.623436 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writing DB stats nova_cell0:SELECT=3 {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:44.625782 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writing DB stats nova_cell1:SELECT=3 {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:44.627026 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:28:44.841064 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-891d8fe1-37e7-472d-a842-5ae752f375a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:28:44.976616 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-891d8fe1-37e7-472d-a842-5ae752f375a9 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.359792 Sep 27 16:28:44.977205 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 3/6] 10.222.0.64 () {64 vars in 1336 bytes} [Tue Sep 27 16:28:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:28:47.595168 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-89069581-7d5a-4dba-9e74-a933afb82d00 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:28:47.596102 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-89069581-7d5a-4dba-9e74-a933afb82d00 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 27 16:28:47.596497 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 4/7] 10.222.0.64 () {54 vars in 931 bytes} [Tue Sep 27 16:28:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:28:48.294335 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-40ca3218-a7b9-48e2-be23-1b692cb2d61c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds512M", "id": "d1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:28:48.427555 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-40ca3218-a7b9-48e2-be23-1b692cb2d61c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.824222 Sep 27 16:28:48.441609 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-67b82aa6-f0b7-43ff-8969-0e8fd5e2a691 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:28:48.447184 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 4/8] 10.222.0.64 () {64 vars in 1283 bytes} [Tue Sep 27 16:28:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 16:28:48.572987 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-67b82aa6-f0b7-43ff-8969-0e8fd5e2a691 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.135097 Sep 27 16:28:48.573756 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 5/9] 10.222.0.64 () {64 vars in 1336 bytes} [Tue Sep 27 16:28:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:28:51.185701 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-40ca3218-a7b9-48e2-be23-1b692cb2d61c admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:28:51.237383 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-40ca3218-a7b9-48e2-be23-1b692cb2d61c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 27 16:28:51.237383 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 931 bytes} [Tue Sep 27 16:28:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:28:51.605287 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-48e861d0-1618-42ea-accc-dc79b73de65c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "disk": 10, "vcpus": 1, "rxtx_factor": 1.0, "ram": 1024, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:28:51.683012 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-48e861d0-1618-42ea-accc-dc79b73de65c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.489699 Sep 27 16:28:51.683576 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 6/11] 10.222.0.64 () {64 vars in 1283 bytes} [Tue Sep 27 16:28:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 16:28:51.696545 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-126ccbbe-40ba-4997-81fe-d0cc2ab1baee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:28:51.795401 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-126ccbbe-40ba-4997-81fe-d0cc2ab1baee admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103328 Sep 27 16:28:51.795987 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 6/12] 10.222.0.64 () {64 vars in 1336 bytes} [Tue Sep 27 16:28:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:28:54.428739 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-48e861d0-1618-42ea-accc-dc79b73de65c admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:28:54.429748 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-48e861d0-1618-42ea-accc-dc79b73de65c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002233 Sep 27 16:28:54.430150 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 7/13] 10.222.0.64 () {54 vars in 931 bytes} [Tue Sep 27 16:28:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:28:54.854101 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-7c2a7e9b-d494-4d09-8dc0-1d26fcd5474d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "name": "ds2G", "disk": 10}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:28:54.935525 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-7c2a7e9b-d494-4d09-8dc0-1d26fcd5474d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.499060 Sep 27 16:28:54.936104 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 7/14] 10.222.0.64 () {64 vars in 1283 bytes} [Tue Sep 27 16:28:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 16:28:54.949268 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-f3a28855-b3c3-4d6a-ad01-8392af104f0d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:28:55.029260 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-f3a28855-b3c3-4d6a-ad01-8392af104f0d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084017 Sep 27 16:28:55.030104 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 8/15] 10.222.0.64 () {64 vars in 1336 bytes} [Tue Sep 27 16:28:54 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:28:57.621287 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-7c2a7e9b-d494-4d09-8dc0-1d26fcd5474d admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:28:57.622308 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-7c2a7e9b-d494-4d09-8dc0-1d26fcd5474d admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 27 16:28:57.622701 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 8/16] 10.222.0.64 () {54 vars in 931 bytes} [Tue Sep 27 16:28:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:28:58.179243 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-dab10201-752d-4415-bcd2-7b68eeea12d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d4", "rxtx_factor": 1.0, "name": "ds4G", "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:28:58.279143 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-dab10201-752d-4415-bcd2-7b68eeea12d5 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.650080 Sep 27 16:28:58.279704 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 9/17] 10.222.0.64 () {64 vars in 1283 bytes} [Tue Sep 27 16:28:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 16:28:58.293799 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-cb7ba27c-c60d-4740-a59c-6c9c86f9f4a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:28:58.382280 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-cb7ba27c-c60d-4740-a59c-6c9c86f9f4a7 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091852 Sep 27 16:28:58.383434 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 9/18] 10.222.0.64 () {64 vars in 1336 bytes} [Tue Sep 27 16:28:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:29:01.360032 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-dab10201-752d-4415-bcd2-7b68eeea12d5 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:01.361151 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-dab10201-752d-4415-bcd2-7b68eeea12d5 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 Sep 27 16:29:01.361573 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 10/19] 10.222.0.64 () {54 vars in 931 bytes} [Tue Sep 27 16:29:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:29:01.849846 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-11cf5666-a934-4636-b6cc-4a0bdc421ad8 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:01.882848 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-11cf5666-a934-4636-b6cc-4a0bdc421ad8 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.514304 Sep 27 16:29:01.883476 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 10/20] 10.222.0.64 () {60 vars in 1292 bytes} [Tue Sep 27 16:29:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:29:04.804866 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-dab10201-752d-4415-bcd2-7b68eeea12d5 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:04.806793 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-dab10201-752d-4415-bcd2-7b68eeea12d5 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002372 Sep 27 16:29:04.807219 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 11/21] 10.222.0.64 () {54 vars in 931 bytes} [Tue Sep 27 16:29:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:29:05.211476 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-4dd8313f-4001-42a3-a2ae-9a20c0fe9c49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true, "id": "1", "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:29:05.290301 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-4dd8313f-4001-42a3-a2ae-9a20c0fe9c49 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.476151 Sep 27 16:29:05.290899 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 11/22] 10.222.0.64 () {64 vars in 1283 bytes} [Tue Sep 27 16:29:04 2022] POST /compute/v2.1/flavors => generated 402 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 16:29:05.302819 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-caca1ff8-9b5e-4ab7-a045-951218d63653 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:29:05.395385 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-caca1ff8-9b5e-4ab7-a045-951218d63653 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096292 Sep 27 16:29:05.396521 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 12/23] 10.222.0.64 () {64 vars in 1333 bytes} [Tue Sep 27 16:29:05 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:29:08.046995 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-4dd8313f-4001-42a3-a2ae-9a20c0fe9c49 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:08.049977 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-4dd8313f-4001-42a3-a2ae-9a20c0fe9c49 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Sep 27 16:29:08.049977 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 12/24] 10.222.0.64 () {54 vars in 931 bytes} [Tue Sep 27 16:29:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:29:08.430316 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-c3227850-8a5a-4684-ad99-5b5962cf33b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "os-flavor-access:is_public": true, "swap": 0, "id": "2", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:29:08.494962 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-c3227850-8a5a-4684-ad99-5b5962cf33b4 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.440011 Sep 27 16:29:08.495512 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 13/25] 10.222.0.64 () {64 vars in 1283 bytes} [Tue Sep 27 16:29:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 16:29:08.507539 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-9ee5d7a5-64eb-4cec-9da6-2e1f29938f2f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:29:08.572930 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-9ee5d7a5-64eb-4cec-9da6-2e1f29938f2f admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068912 Sep 27 16:29:08.573940 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 13/26] 10.222.0.64 () {64 vars in 1333 bytes} [Tue Sep 27 16:29:08 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:29:11.305286 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-c3227850-8a5a-4684-ad99-5b5962cf33b4 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:11.307440 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-c3227850-8a5a-4684-ad99-5b5962cf33b4 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002722 Sep 27 16:29:11.308338 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 14/27] 10.222.0.64 () {54 vars in 931 bytes} [Tue Sep 27 16:29:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:29:11.799221 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-5c703d65-c23d-4d5d-98fc-538f3b9dccf1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "name": "m1.medium", "vcpus": 2, "swap": 0, "disk": 40}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:29:12.135308 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-5c703d65-c23d-4d5d-98fc-538f3b9dccf1 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.820476 Sep 27 16:29:12.136561 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 14/28] 10.222.0.64 () {64 vars in 1283 bytes} [Tue Sep 27 16:29:11 2022] POST /compute/v2.1/flavors => generated 406 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 16:29:12.149412 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-64269baf-ef2b-43a8-9098-2b49608dccd7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:29:12.158609 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:12.254593 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-64269baf-ef2b-43a8-9098-2b49608dccd7 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109413 Sep 27 16:29:12.271248 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 15/29] 10.222.0.64 () {64 vars in 1333 bytes} [Tue Sep 27 16:29:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:29:14.957767 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-5c703d65-c23d-4d5d-98fc-538f3b9dccf1 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:14.959277 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-5c703d65-c23d-4d5d-98fc-538f3b9dccf1 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002028 Sep 27 16:29:14.959682 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 15/30] 10.222.0.64 () {54 vars in 931 bytes} [Tue Sep 27 16:29:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:29:15.418491 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-ab63bcb4-29cd-4862-98e1-dea3df3209d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 80, "vcpus": 4, "id": "4"}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:29:15.493788 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-ab63bcb4-29cd-4862-98e1-dea3df3209d5 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.527905 Sep 27 16:29:15.494639 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 16/31] 10.222.0.64 () {64 vars in 1283 bytes} [Tue Sep 27 16:29:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 16:29:15.507427 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-f2ec0f3c-617d-468d-9433-84eb273d5daf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:29:15.513541 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:15.611670 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-f2ec0f3c-617d-468d-9433-84eb273d5daf admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108053 Sep 27 16:29:15.619121 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 16/32] 10.222.0.64 () {64 vars in 1333 bytes} [Tue Sep 27 16:29:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:29:18.266188 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-ab63bcb4-29cd-4862-98e1-dea3df3209d5 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:18.267294 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-ab63bcb4-29cd-4862-98e1-dea3df3209d5 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Sep 27 16:29:18.268052 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 17/33] 10.222.0.64 () {54 vars in 931 bytes} [Tue Sep 27 16:29:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:29:18.716449 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-22035afb-2244-4d7f-b892-18ce6ee0f4bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 8, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge"}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:29:18.780610 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-22035afb-2244-4d7f-b892-18ce6ee0f4bc admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.506273 Sep 27 16:29:18.781339 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 17/34] 10.222.0.64 () {64 vars in 1283 bytes} [Tue Sep 27 16:29:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 16:29:18.794642 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-c51f9773-0b32-4db2-b278-4b65c814417b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:29:18.874589 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-c51f9773-0b32-4db2-b278-4b65c814417b admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084523 Sep 27 16:29:18.875229 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 18/35] 10.222.0.64 () {64 vars in 1333 bytes} [Tue Sep 27 16:29:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:29:36.010859 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-22035afb-2244-4d7f-b892-18ce6ee0f4bc admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:36.011769 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-22035afb-2244-4d7f-b892-18ce6ee0f4bc admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 27 16:29:36.012167 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 18/36] 10.222.0.64 () {54 vars in 931 bytes} [Tue Sep 27 16:29:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:29:36.022881 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:36.403360 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-ab02fb92-ac58-4093-acb1-1129414b883d admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:36.421261 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-ab02fb92-ac58-4093-acb1-1129414b883d admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403023 Sep 27 16:29:36.421784 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 19/37] 10.222.0.64 () {60 vars in 1292 bytes} [Tue Sep 27 16:29:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:29:37.733374 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-22035afb-2244-4d7f-b892-18ce6ee0f4bc admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:37.734375 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-22035afb-2244-4d7f-b892-18ce6ee0f4bc admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 27 16:29:37.734820 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 19/38] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Sep 27 16:29:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:29:38.266482 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-63cab7b0-4acc-4f6e-8d2b-d641dd955cb7 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:38.271880 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.wsgi [None req-63cab7b0-4acc-4f6e-8d2b-d641dd955cb7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 27 16:29:38.275767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-63cab7b0-4acc-4f6e-8d2b-d641dd955cb7 admin admin] Request method failure captured: Sep 27 16:29:38.275767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 27 16:29:38.275767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: Accept: application/json Sep 27 16:29:38.275767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: Accept-Encoding: gzip, deflate Sep 27 16:29:38.275767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: Connection: keep-alive Sep 27 16:29:38.275767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: Content-Length: 0 Sep 27 16:29:38.275767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: Host: 10.222.0.64 Sep 27 16:29:38.275767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: Openstack-Api-Version: compute 2.92 Sep 27 16:29:38.275767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: Openstack-System-Scope: None Sep 27 16:29:38.275767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: User-Agent: python-novaclient Sep 27 16:29:38.275767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Auth-Token: gAAAAABjMyTxYyX4qE911Pmi9qUo53QzsdEdLFuvQYFWX7-XNEHuxeGQ570CAljIjc8jgSfneNE_N0AWBuJGJXXh1q7vkonkjNbOgDadeWoR4Fz8xx-2VKD6wwwz3kKrG0ewYu_MSaw10HJp-wQP2mNF0ZRHZynA1i38fYxiD1bJCeQw5ITYihw Sep 27 16:29:38.275767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Domain-Id: None Sep 27 16:29:38.275767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Domain-Name: None Sep 27 16:29:38.275767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Identity-Status: Confirmed Sep 27 16:29:38.275767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Is-Admin-Project: True Sep 27 16:29:38.275767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Openstack-Nova-Api-Version: 2.92 Sep 27 16:29:38.275767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Project-Domain-Id: default Sep 27 16:29:38.275767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Project-Domain-Name: Default Sep 27 16:29:38.275767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Project-Id: 9ac75ab2f7e84b088f06cdcdbcfae272 Sep 27 16:29:38.275767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Project-Name: admin Sep 27 16:29:38.275767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Role: reader,admin,member Sep 27 16:29:38.275767 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Roles: reader,admin,member Sep 27 16:29:38.277344 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:29:38.277344 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Tenant: admin Sep 27 16:29:38.277344 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Tenant-Id: 9ac75ab2f7e84b088f06cdcdbcfae272 Sep 27 16:29:38.277344 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Tenant-Name: admin Sep 27 16:29:38.277344 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-User: admin Sep 27 16:29:38.277344 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-User-Domain-Id: default Sep 27 16:29:38.277344 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-User-Domain-Name: Default Sep 27 16:29:38.277344 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-User-Id: 3c05ec42fc16441e83ec77e10313ea85 Sep 27 16:29:38.277344 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-User-Name: admin Sep 27 16:29:38.277344 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: method: > Sep 27 16:29:38.277344 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: exception: Flavor 42 could not be found. Sep 27 16:29:38.277344 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: action_args: {'id': '42'} Sep 27 16:29:38.277344 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:29:38.277344 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:29:38.278312 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 27 16:29:38.278312 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 27 16:29:38.278312 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 27 16:29:38.278312 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 27 16:29:38.278312 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 16:29:38.278312 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 16:29:38.278312 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 27 16:29:38.278312 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 27 16:29:38.278312 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 27 16:29:38.278312 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:29:38.278312 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 27 16:29:38.278312 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 27 16:29:38.278312 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 27 16:29:38.278312 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 27 16:29:38.278312 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:29:38.278312 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 27 16:29:38.278312 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:29:38.278312 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:29:38.278312 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:29:38.279659 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:29:38.279659 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:29:38.279659 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:29:38.279659 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:29:38.279659 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 27 16:29:38.279659 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:29:38.279659 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 27 16:29:38.279659 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 27 16:29:38.279659 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:29:38.279659 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 27 16:29:38.279659 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:29:38.279659 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:29:38.279659 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:29:38.279659 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:29:38.279659 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:29:38.279659 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 27 16:29:38.279659 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 27 16:29:38.279659 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-63cab7b0-4acc-4f6e-8d2b-d641dd955cb7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:29:38.280989 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-63cab7b0-4acc-4f6e-8d2b-d641dd955cb7 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.397204 Sep 27 16:29:38.280989 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 20/39] 10.222.0.64 () {60 vars in 1190 bytes} [Tue Sep 27 16:29:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 27 16:29:38.286917 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-cfe41f94-c206-48fc-aebe-68036e7330de admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:38.291539 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:29:38.310799 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-cfe41f94-c206-48fc-aebe-68036e7330de admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027421 Sep 27 16:29:38.311341 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 20/40] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Sep 27 16:29:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:29:38.322530 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-7da55846-a8b5-4797-9376-e2ef70f12535 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:38.344937 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-7da55846-a8b5-4797-9376-e2ef70f12535 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027481 Sep 27 16:29:38.345489 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 21/41] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Sep 27 16:29:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:29:38.355807 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-32037681-fbfc-4e7d-80f6-1930a00a02bf admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:38.361474 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.wsgi [None req-32037681-fbfc-4e7d-80f6-1930a00a02bf admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 27 16:29:38.364721 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-32037681-fbfc-4e7d-80f6-1930a00a02bf admin admin] Request method failure captured: Sep 27 16:29:38.364721 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 27 16:29:38.364721 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: Accept: application/json Sep 27 16:29:38.364721 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: Accept-Encoding: gzip, deflate Sep 27 16:29:38.364721 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: Connection: keep-alive Sep 27 16:29:38.364721 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: Content-Length: 0 Sep 27 16:29:38.364721 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: Host: 10.222.0.64 Sep 27 16:29:38.364721 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: Openstack-Api-Version: compute 2.92 Sep 27 16:29:38.364721 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: Openstack-System-Scope: None Sep 27 16:29:38.364721 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: User-Agent: python-novaclient Sep 27 16:29:38.364721 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Auth-Token: gAAAAABjMyTxYyX4qE911Pmi9qUo53QzsdEdLFuvQYFWX7-XNEHuxeGQ570CAljIjc8jgSfneNE_N0AWBuJGJXXh1q7vkonkjNbOgDadeWoR4Fz8xx-2VKD6wwwz3kKrG0ewYu_MSaw10HJp-wQP2mNF0ZRHZynA1i38fYxiD1bJCeQw5ITYihw Sep 27 16:29:38.364721 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Domain-Id: None Sep 27 16:29:38.364721 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Domain-Name: None Sep 27 16:29:38.364721 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Identity-Status: Confirmed Sep 27 16:29:38.364721 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Is-Admin-Project: True Sep 27 16:29:38.364721 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Openstack-Nova-Api-Version: 2.92 Sep 27 16:29:38.364721 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Project-Domain-Id: default Sep 27 16:29:38.364721 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Project-Domain-Name: Default Sep 27 16:29:38.364721 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Project-Id: 9ac75ab2f7e84b088f06cdcdbcfae272 Sep 27 16:29:38.364721 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Project-Name: admin Sep 27 16:29:38.364721 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Role: reader,admin,member Sep 27 16:29:38.364721 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Roles: reader,admin,member Sep 27 16:29:38.366985 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:29:38.366985 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Tenant: admin Sep 27 16:29:38.366985 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Tenant-Id: 9ac75ab2f7e84b088f06cdcdbcfae272 Sep 27 16:29:38.366985 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Tenant-Name: admin Sep 27 16:29:38.366985 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-User: admin Sep 27 16:29:38.366985 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-User-Domain-Id: default Sep 27 16:29:38.366985 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-User-Domain-Name: Default Sep 27 16:29:38.366985 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-User-Id: 3c05ec42fc16441e83ec77e10313ea85 Sep 27 16:29:38.366985 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-User-Name: admin Sep 27 16:29:38.366985 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: method: > Sep 27 16:29:38.366985 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: exception: Flavor 42 could not be found. Sep 27 16:29:38.366985 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: action_args: {'id': '42'} Sep 27 16:29:38.366985 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:29:38.366985 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:29:38.367793 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 27 16:29:38.367793 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 27 16:29:38.367793 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 27 16:29:38.367793 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 27 16:29:38.367793 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 16:29:38.367793 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 16:29:38.367793 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 27 16:29:38.367793 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 27 16:29:38.367793 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 27 16:29:38.367793 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:29:38.367793 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 27 16:29:38.367793 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 27 16:29:38.367793 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 27 16:29:38.367793 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 27 16:29:38.367793 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:29:38.367793 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 27 16:29:38.367793 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:29:38.367793 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:29:38.367793 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:29:38.369040 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:29:38.369040 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:29:38.369040 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:29:38.369040 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:29:38.369040 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 27 16:29:38.369040 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:29:38.369040 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 27 16:29:38.369040 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 27 16:29:38.369040 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:29:38.369040 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 27 16:29:38.369040 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:29:38.369040 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:29:38.369040 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:29:38.369040 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:29:38.369040 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:29:38.369040 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 27 16:29:38.369040 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 27 16:29:38.369040 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-32037681-fbfc-4e7d-80f6-1930a00a02bf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:29:38.370309 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-32037681-fbfc-4e7d-80f6-1930a00a02bf admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014141 Sep 27 16:29:38.370309 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 21/42] 10.222.0.64 () {60 vars in 1190 bytes} [Tue Sep 27 16:29:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 27 16:29:39.588866 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-7da55846-a8b5-4797-9376-e2ef70f12535 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:39.589916 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-7da55846-a8b5-4797-9376-e2ef70f12535 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 27 16:29:39.590335 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 22/43] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Sep 27 16:29:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:29:40.111535 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-3a55249e-70f2-46f5-9f3d-0ed115141327 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:40.117036 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.wsgi [None req-3a55249e-70f2-46f5-9f3d-0ed115141327 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 27 16:29:40.118798 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-3a55249e-70f2-46f5-9f3d-0ed115141327 admin admin] Request method failure captured: Sep 27 16:29:40.118798 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 27 16:29:40.118798 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: Accept: application/json Sep 27 16:29:40.118798 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: Accept-Encoding: gzip, deflate Sep 27 16:29:40.118798 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: Connection: keep-alive Sep 27 16:29:40.118798 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: Content-Length: 0 Sep 27 16:29:40.118798 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: Host: 10.222.0.64 Sep 27 16:29:40.118798 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: Openstack-Api-Version: compute 2.92 Sep 27 16:29:40.118798 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: Openstack-System-Scope: None Sep 27 16:29:40.118798 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: User-Agent: python-novaclient Sep 27 16:29:40.118798 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Auth-Token: gAAAAABjMyTzcHlThkSexQnNr-Rsy33hPD1fwORCK97bwRMLfbYOLHWgU04qaT7_wYtzeDWgwNOKSLAvvU_GKSuuj8lbiEZbcz_R6Dtrh64zvRONdbXrEDlJynS9pLC1BckeJ5aTAkelEwvTm5oQeP-8g1Z8cNr7hj30FaipszhVLBy3jRB57sk Sep 27 16:29:40.118798 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Domain-Id: None Sep 27 16:29:40.118798 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Domain-Name: None Sep 27 16:29:40.118798 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Identity-Status: Confirmed Sep 27 16:29:40.118798 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Is-Admin-Project: True Sep 27 16:29:40.118798 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Openstack-Nova-Api-Version: 2.92 Sep 27 16:29:40.118798 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Project-Domain-Id: default Sep 27 16:29:40.118798 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Project-Domain-Name: Default Sep 27 16:29:40.118798 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Project-Id: 9ac75ab2f7e84b088f06cdcdbcfae272 Sep 27 16:29:40.118798 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Project-Name: admin Sep 27 16:29:40.118798 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Role: reader,admin,member Sep 27 16:29:40.118798 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Roles: reader,admin,member Sep 27 16:29:40.120287 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:29:40.120287 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Tenant: admin Sep 27 16:29:40.120287 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Tenant-Id: 9ac75ab2f7e84b088f06cdcdbcfae272 Sep 27 16:29:40.120287 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Tenant-Name: admin Sep 27 16:29:40.120287 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-User: admin Sep 27 16:29:40.120287 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-User-Domain-Id: default Sep 27 16:29:40.120287 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-User-Domain-Name: Default Sep 27 16:29:40.120287 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-User-Id: 3c05ec42fc16441e83ec77e10313ea85 Sep 27 16:29:40.120287 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-User-Name: admin Sep 27 16:29:40.120287 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: method: > Sep 27 16:29:40.120287 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: exception: Flavor 84 could not be found. Sep 27 16:29:40.120287 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: action_args: {'id': '84'} Sep 27 16:29:40.120287 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:29:40.120287 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:29:40.121309 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 27 16:29:40.121309 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 27 16:29:40.121309 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 27 16:29:40.121309 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 27 16:29:40.121309 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 16:29:40.121309 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 16:29:40.121309 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 27 16:29:40.121309 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 27 16:29:40.121309 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 27 16:29:40.121309 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:29:40.121309 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 27 16:29:40.121309 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 27 16:29:40.121309 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 27 16:29:40.121309 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 27 16:29:40.121309 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:29:40.121309 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 27 16:29:40.121309 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:29:40.121309 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:29:40.121309 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:29:40.122595 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:29:40.122595 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:29:40.122595 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:29:40.122595 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:29:40.122595 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 27 16:29:40.122595 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:29:40.122595 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 27 16:29:40.122595 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 27 16:29:40.122595 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:29:40.122595 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 27 16:29:40.122595 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:29:40.122595 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:29:40.122595 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:29:40.122595 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:29:40.122595 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:29:40.122595 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 27 16:29:40.122595 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 27 16:29:40.122595 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-3a55249e-70f2-46f5-9f3d-0ed115141327 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:29:40.123901 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-3a55249e-70f2-46f5-9f3d-0ed115141327 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.389787 Sep 27 16:29:40.123901 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 22/44] 10.222.0.64 () {60 vars in 1190 bytes} [Tue Sep 27 16:29:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 27 16:29:40.129939 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-cc4e5ac4-1c5a-44e1-bd4b-3dab33d2e4aa admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:40.148283 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-cc4e5ac4-1c5a-44e1-bd4b-3dab33d2e4aa admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018759 Sep 27 16:29:40.148283 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 23/45] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Sep 27 16:29:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:29:40.155749 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-1b683034-9cfb-4903-adc3-3bec674048f7 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:40.171130 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-1b683034-9cfb-4903-adc3-3bec674048f7 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019043 Sep 27 16:29:40.171660 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 23/46] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Sep 27 16:29:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:29:40.185549 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-dabc759b-bb69-45aa-944c-9d761ba04eba admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:40.190646 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.wsgi [None req-dabc759b-bb69-45aa-944c-9d761ba04eba admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 27 16:29:40.192210 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-dabc759b-bb69-45aa-944c-9d761ba04eba admin admin] Request method failure captured: Sep 27 16:29:40.192210 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 27 16:29:40.192210 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: Accept: application/json Sep 27 16:29:40.192210 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: Accept-Encoding: gzip, deflate Sep 27 16:29:40.192210 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: Connection: keep-alive Sep 27 16:29:40.192210 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: Content-Length: 0 Sep 27 16:29:40.192210 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: Host: 10.222.0.64 Sep 27 16:29:40.192210 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: Openstack-Api-Version: compute 2.92 Sep 27 16:29:40.192210 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: Openstack-System-Scope: None Sep 27 16:29:40.192210 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: User-Agent: python-novaclient Sep 27 16:29:40.192210 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Auth-Token: gAAAAABjMyTzcHlThkSexQnNr-Rsy33hPD1fwORCK97bwRMLfbYOLHWgU04qaT7_wYtzeDWgwNOKSLAvvU_GKSuuj8lbiEZbcz_R6Dtrh64zvRONdbXrEDlJynS9pLC1BckeJ5aTAkelEwvTm5oQeP-8g1Z8cNr7hj30FaipszhVLBy3jRB57sk Sep 27 16:29:40.192210 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Domain-Id: None Sep 27 16:29:40.192210 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Domain-Name: None Sep 27 16:29:40.192210 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Identity-Status: Confirmed Sep 27 16:29:40.192210 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Is-Admin-Project: True Sep 27 16:29:40.192210 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Openstack-Nova-Api-Version: 2.92 Sep 27 16:29:40.192210 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Project-Domain-Id: default Sep 27 16:29:40.192210 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Project-Domain-Name: Default Sep 27 16:29:40.192210 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Project-Id: 9ac75ab2f7e84b088f06cdcdbcfae272 Sep 27 16:29:40.192210 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Project-Name: admin Sep 27 16:29:40.192210 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Role: reader,admin,member Sep 27 16:29:40.192210 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Roles: reader,admin,member Sep 27 16:29:40.193636 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:29:40.193636 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Tenant: admin Sep 27 16:29:40.193636 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Tenant-Id: 9ac75ab2f7e84b088f06cdcdbcfae272 Sep 27 16:29:40.193636 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Tenant-Name: admin Sep 27 16:29:40.193636 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-User: admin Sep 27 16:29:40.193636 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-User-Domain-Id: default Sep 27 16:29:40.193636 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-User-Domain-Name: Default Sep 27 16:29:40.193636 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-User-Id: 3c05ec42fc16441e83ec77e10313ea85 Sep 27 16:29:40.193636 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-User-Name: admin Sep 27 16:29:40.193636 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: method: > Sep 27 16:29:40.193636 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: exception: Flavor 84 could not be found. Sep 27 16:29:40.193636 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: action_args: {'id': '84'} Sep 27 16:29:40.193636 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:29:40.193636 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:29:40.195023 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 27 16:29:40.195023 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 27 16:29:40.195023 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 27 16:29:40.195023 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 27 16:29:40.195023 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 16:29:40.195023 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 16:29:40.195023 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 27 16:29:40.195023 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 27 16:29:40.195023 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 27 16:29:40.195023 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:29:40.195023 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 27 16:29:40.195023 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 27 16:29:40.195023 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 27 16:29:40.195023 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 27 16:29:40.195023 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:29:40.195023 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 27 16:29:40.195023 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:29:40.195023 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:29:40.195023 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:29:40.196464 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:29:40.196464 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:29:40.196464 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:29:40.196464 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:29:40.196464 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 27 16:29:40.196464 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:29:40.196464 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 27 16:29:40.196464 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 27 16:29:40.196464 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:29:40.196464 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 27 16:29:40.196464 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:29:40.196464 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:29:40.196464 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:29:40.196464 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:29:40.196464 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:29:40.196464 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 27 16:29:40.196464 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 27 16:29:40.196464 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-dabc759b-bb69-45aa-944c-9d761ba04eba admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:29:40.197682 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-dabc759b-bb69-45aa-944c-9d761ba04eba admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011717 Sep 27 16:29:40.197682 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 24/47] 10.222.0.64 () {60 vars in 1190 bytes} [Tue Sep 27 16:29:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 27 16:29:41.409127 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-1b683034-9cfb-4903-adc3-3bec674048f7 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:41.410163 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-1b683034-9cfb-4903-adc3-3bec674048f7 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Sep 27 16:29:41.410549 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 24/48] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Sep 27 16:29:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:29:41.927805 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-69e370a3-9aa4-4c34-8c24-d71044f12431 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:41.934463 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.wsgi [None req-69e370a3-9aa4-4c34-8c24-d71044f12431 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 27 16:29:41.936000 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-69e370a3-9aa4-4c34-8c24-d71044f12431 admin admin] Request method failure captured: Sep 27 16:29:41.936000 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 27 16:29:41.936000 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: Accept: application/json Sep 27 16:29:41.936000 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: Accept-Encoding: gzip, deflate Sep 27 16:29:41.936000 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: Connection: keep-alive Sep 27 16:29:41.936000 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: Content-Length: 0 Sep 27 16:29:41.936000 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: Host: 10.222.0.64 Sep 27 16:29:41.936000 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: Openstack-Api-Version: compute 2.92 Sep 27 16:29:41.936000 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: Openstack-System-Scope: None Sep 27 16:29:41.936000 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: User-Agent: python-novaclient Sep 27 16:29:41.936000 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Auth-Token: gAAAAABjMyT1uR2MQhEMaHNOX3n5hTxQ78WVdED07HAFMFte24ro4y1C2iFKl_5IYarL1tzYOPbXMnwdoEV5PGy41vGskmgAc09t7AEfqcvQO7hb0OPbNf7iXViGlU_6DjEd6oMOSkFNlF08ipN-WMNE5_oeYnbng5691Aacoo2tCRGESZoQ16Y Sep 27 16:29:41.936000 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Domain-Id: None Sep 27 16:29:41.936000 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Domain-Name: None Sep 27 16:29:41.936000 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Identity-Status: Confirmed Sep 27 16:29:41.936000 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Is-Admin-Project: True Sep 27 16:29:41.936000 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Openstack-Nova-Api-Version: 2.92 Sep 27 16:29:41.936000 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Project-Domain-Id: default Sep 27 16:29:41.936000 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Project-Domain-Name: Default Sep 27 16:29:41.936000 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Project-Id: 9ac75ab2f7e84b088f06cdcdbcfae272 Sep 27 16:29:41.936000 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Project-Name: admin Sep 27 16:29:41.936000 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Role: reader,admin,member Sep 27 16:29:41.936000 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Roles: reader,admin,member Sep 27 16:29:41.937578 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:29:41.937578 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Tenant: admin Sep 27 16:29:41.937578 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Tenant-Id: 9ac75ab2f7e84b088f06cdcdbcfae272 Sep 27 16:29:41.937578 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-Tenant-Name: admin Sep 27 16:29:41.937578 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-User: admin Sep 27 16:29:41.937578 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-User-Domain-Id: default Sep 27 16:29:41.937578 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-User-Domain-Name: Default Sep 27 16:29:41.937578 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-User-Id: 3c05ec42fc16441e83ec77e10313ea85 Sep 27 16:29:41.937578 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: X-User-Name: admin Sep 27 16:29:41.937578 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: method: > Sep 27 16:29:41.937578 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: exception: Flavor 451 could not be found. Sep 27 16:29:41.937578 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: action_args: {'id': '451'} Sep 27 16:29:41.937578 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:29:41.937578 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:29:41.938478 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 27 16:29:41.938478 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 27 16:29:41.938478 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 27 16:29:41.938478 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 27 16:29:41.938478 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 16:29:41.938478 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 16:29:41.938478 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 27 16:29:41.938478 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 27 16:29:41.938478 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 27 16:29:41.938478 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:29:41.938478 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 27 16:29:41.938478 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 27 16:29:41.938478 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 27 16:29:41.938478 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 27 16:29:41.938478 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:29:41.938478 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 27 16:29:41.938478 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:29:41.938478 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:29:41.938478 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:29:41.939654 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:29:41.939654 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:29:41.939654 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:29:41.939654 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:29:41.939654 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 27 16:29:41.939654 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:29:41.939654 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 27 16:29:41.939654 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 27 16:29:41.939654 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:29:41.939654 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 27 16:29:41.939654 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:29:41.939654 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:29:41.939654 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:29:41.939654 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:29:41.939654 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:29:41.939654 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 27 16:29:41.939654 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: ERROR nova.api.openstack.wsgi Sep 27 16:29:41.939654 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-69e370a3-9aa4-4c34-8c24-d71044f12431 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:29:41.940690 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-69e370a3-9aa4-4c34-8c24-d71044f12431 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.387662 Sep 27 16:29:41.940690 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 25/49] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Sep 27 16:29:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 27 16:29:41.948527 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-d5f4bc81-7a7a-4b8e-b564-972e2afb1f09 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:41.964652 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-d5f4bc81-7a7a-4b8e-b564-972e2afb1f09 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020710 Sep 27 16:29:41.965175 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 25/50] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Sep 27 16:29:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:29:41.974541 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-f4ab5ce0-b651-4b0b-a6b9-4f4070b95347 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:41.989194 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-f4ab5ce0-b651-4b0b-a6b9-4f4070b95347 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018064 Sep 27 16:29:41.994072 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 26/51] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Sep 27 16:29:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:29:42.002131 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-a1ceed89-0ca8-40b8-a8f9-c69694a3cd03 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:42.007644 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.wsgi [None req-a1ceed89-0ca8-40b8-a8f9-c69694a3cd03 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 27 16:29:42.009145 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-a1ceed89-0ca8-40b8-a8f9-c69694a3cd03 admin admin] Request method failure captured: Sep 27 16:29:42.009145 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 27 16:29:42.009145 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: Accept: application/json Sep 27 16:29:42.009145 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: Accept-Encoding: gzip, deflate Sep 27 16:29:42.009145 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: Connection: keep-alive Sep 27 16:29:42.009145 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: Content-Length: 0 Sep 27 16:29:42.009145 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: Host: 10.222.0.64 Sep 27 16:29:42.009145 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: Openstack-Api-Version: compute 2.92 Sep 27 16:29:42.009145 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: Openstack-System-Scope: None Sep 27 16:29:42.009145 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: User-Agent: python-novaclient Sep 27 16:29:42.009145 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Auth-Token: gAAAAABjMyT1uR2MQhEMaHNOX3n5hTxQ78WVdED07HAFMFte24ro4y1C2iFKl_5IYarL1tzYOPbXMnwdoEV5PGy41vGskmgAc09t7AEfqcvQO7hb0OPbNf7iXViGlU_6DjEd6oMOSkFNlF08ipN-WMNE5_oeYnbng5691Aacoo2tCRGESZoQ16Y Sep 27 16:29:42.009145 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Domain-Id: None Sep 27 16:29:42.009145 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Domain-Name: None Sep 27 16:29:42.009145 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Identity-Status: Confirmed Sep 27 16:29:42.009145 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Is-Admin-Project: True Sep 27 16:29:42.009145 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Openstack-Nova-Api-Version: 2.92 Sep 27 16:29:42.009145 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Project-Domain-Id: default Sep 27 16:29:42.009145 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Project-Domain-Name: Default Sep 27 16:29:42.009145 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Project-Id: 9ac75ab2f7e84b088f06cdcdbcfae272 Sep 27 16:29:42.009145 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Project-Name: admin Sep 27 16:29:42.009145 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Role: reader,admin,member Sep 27 16:29:42.009145 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Roles: reader,admin,member Sep 27 16:29:42.010480 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9ac75ab2f7e84b088f06cdcdbcfae272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:29:42.010480 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Tenant: admin Sep 27 16:29:42.010480 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Tenant-Id: 9ac75ab2f7e84b088f06cdcdbcfae272 Sep 27 16:29:42.010480 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-Tenant-Name: admin Sep 27 16:29:42.010480 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-User: admin Sep 27 16:29:42.010480 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-User-Domain-Id: default Sep 27 16:29:42.010480 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-User-Domain-Name: Default Sep 27 16:29:42.010480 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-User-Id: 3c05ec42fc16441e83ec77e10313ea85 Sep 27 16:29:42.010480 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: X-User-Name: admin Sep 27 16:29:42.010480 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: method: > Sep 27 16:29:42.010480 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: exception: Flavor 451 could not be found. Sep 27 16:29:42.010480 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: action_args: {'id': '451'} Sep 27 16:29:42.010480 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:29:42.010480 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:29:42.011317 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 27 16:29:42.011317 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 27 16:29:42.011317 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 27 16:29:42.011317 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 27 16:29:42.011317 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 16:29:42.011317 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 16:29:42.011317 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 27 16:29:42.011317 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 27 16:29:42.011317 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 27 16:29:42.011317 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:29:42.011317 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 27 16:29:42.011317 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 27 16:29:42.011317 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 27 16:29:42.011317 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 27 16:29:42.011317 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:29:42.011317 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 27 16:29:42.011317 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:29:42.011317 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:29:42.011317 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:29:42.012374 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:29:42.012374 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:29:42.012374 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:29:42.012374 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:29:42.012374 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 27 16:29:42.012374 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:29:42.012374 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 27 16:29:42.012374 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 27 16:29:42.012374 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:29:42.012374 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 27 16:29:42.012374 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:29:42.012374 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:29:42.012374 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:29:42.012374 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:29:42.012374 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:29:42.012374 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 27 16:29:42.012374 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: ERROR nova.api.openstack.wsgi Sep 27 16:29:42.012374 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-a1ceed89-0ca8-40b8-a8f9-c69694a3cd03 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:29:42.013440 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-a1ceed89-0ca8-40b8-a8f9-c69694a3cd03 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011970 Sep 27 16:29:42.013440 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 26/52] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Sep 27 16:29:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 27 16:29:43.218823 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-f4ab5ce0-b651-4b0b-a6b9-4f4070b95347 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:43.219852 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-f4ab5ce0-b651-4b0b-a6b9-4f4070b95347 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 27 16:29:43.220242 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 27/53] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Sep 27 16:29:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:29:43.744611 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-0623eef0-4a12-4649-bccb-898de39bb6c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:29:43.812885 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-0623eef0-4a12-4649-bccb-898de39bb6c9 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.452379 Sep 27 16:29:43.813434 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 27/54] 10.222.0.64 () {64 vars in 1235 bytes} [Tue Sep 27 16:29:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 16:29:45.034805 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-f4ab5ce0-b651-4b0b-a6b9-4f4070b95347 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:45.035806 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-f4ab5ce0-b651-4b0b-a6b9-4f4070b95347 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 27 16:29:45.036195 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 28/55] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Sep 27 16:29:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:29:45.551079 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-825cc177-54a4-473e-8b16-74acefeacb2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:29:45.634891 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-825cc177-54a4-473e-8b16-74acefeacb2c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.460579 Sep 27 16:29:45.635431 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 28/56] 10.222.0.64 () {64 vars in 1235 bytes} [Tue Sep 27 16:29:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 16:29:46.845999 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-f4ab5ce0-b651-4b0b-a6b9-4f4070b95347 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:46.847083 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-f4ab5ce0-b651-4b0b-a6b9-4f4070b95347 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 27 16:29:46.847482 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 29/57] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Sep 27 16:29:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:29:47.364867 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-adcfd62a-be30-436e-94bd-dd5b0d66d09a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:29:47.446417 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-adcfd62a-be30-436e-94bd-dd5b0d66d09a admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.463026 Sep 27 16:29:47.446980 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 29/58] 10.222.0.64 () {64 vars in 1235 bytes} [Tue Sep 27 16:29:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 16:29:48.659662 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-f4ab5ce0-b651-4b0b-a6b9-4f4070b95347 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:48.660689 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-f4ab5ce0-b651-4b0b-a6b9-4f4070b95347 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 27 16:29:48.661115 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 30/59] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Sep 27 16:29:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:29:49.177789 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-2233df47-e415-4a1b-80d7-05387da76686 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:29:49.256990 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-2233df47-e415-4a1b-80d7-05387da76686 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.458727 Sep 27 16:29:49.257443 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 30/60] 10.222.0.64 () {64 vars in 1235 bytes} [Tue Sep 27 16:29:48 2022] POST /compute/v2.1/flavors => generated 409 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 16:29:50.482002 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-f4ab5ce0-b651-4b0b-a6b9-4f4070b95347 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:50.483029 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-f4ab5ce0-b651-4b0b-a6b9-4f4070b95347 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Sep 27 16:29:50.483420 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 31/61] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Sep 27 16:29:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:29:51.003125 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-25d6b284-6873-47ee-b66e-4f3416307a87 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:29:51.025521 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-25d6b284-6873-47ee-b66e-4f3416307a87 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.406399 Sep 27 16:29:51.026056 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 31/62] 10.222.0.64 () {60 vars in 1202 bytes} [Tue Sep 27 16:29:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:30:48.521266 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-f4ab5ce0-b651-4b0b-a6b9-4f4070b95347 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:30:48.522266 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-f4ab5ce0-b651-4b0b-a6b9-4f4070b95347 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 27 16:30:48.522671 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 32/63] 10.222.0.64 () {54 vars in 931 bytes} [Tue Sep 27 16:30:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:30:48.533350 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:48.906045 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-66f002ab-d9e3-4094-873c-f4ed42755b93 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:30:48.927456 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-66f002ab-d9e3-4094-873c-f4ed42755b93 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.398313 Sep 27 16:30:48.927993 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 32/64] 10.222.0.64 () {60 vars in 1292 bytes} [Tue Sep 27 16:30:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:30:48.948471 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writing DB stats nova_api:SELECT=14 {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:30:48.952069 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-efce957f-2538-4b98-af43-accb6cd0451d admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:30:48.959352 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-efce957f-2538-4b98-af43-accb6cd0451d admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012177 Sep 27 16:30:48.959867 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 33/65] 10.222.0.64 () {60 vars in 1283 bytes} [Tue Sep 27 16:30:48 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:30:48.971566 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-7873fd37-5b9a-4a48-9421-70486ad2ae99 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:30:48.979351 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-7873fd37-5b9a-4a48-9421-70486ad2ae99 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011442 Sep 27 16:30:48.979861 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 33/66] 10.222.0.64 () {60 vars in 1286 bytes} [Tue Sep 27 16:30:48 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:30:48.991789 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-370a512e-bf84-4033-a7fb-47c6a84a89b4 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:30:48.999053 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-370a512e-bf84-4033-a7fb-47c6a84a89b4 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011416 Sep 27 16:30:48.999556 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 34/67] 10.222.0.64 () {60 vars in 1286 bytes} [Tue Sep 27 16:30:48 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:30:49.010573 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-4e04d061-8a25-41a9-816f-9117208923cd admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:30:49.017624 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-4e04d061-8a25-41a9-816f-9117208923cd admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010507 Sep 27 16:30:49.018125 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 34/68] 10.222.0.64 () {60 vars in 1283 bytes} [Tue Sep 27 16:30:49 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:34:25.485443 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-370a512e-bf84-4033-a7fb-47c6a84a89b4 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:34:25.486449 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-370a512e-bf84-4033-a7fb-47c6a84a89b4 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 27 16:34:25.486864 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 35/69] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Sep 27 16:34:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:34:25.631620 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writing DB stats nova_api:SELECT=6 {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:34:25.776279 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-5d5a5f0c-7977-4c42-811b-24546cccd799 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:34:25.781059 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-5d5a5f0c-7977-4c42-811b-24546cccd799 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:34:25.781532 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-5d5a5f0c-7977-4c42-811b-24546cccd799 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:34:25.781955 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-5d5a5f0c-7977-4c42-811b-24546cccd799 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:34:25.782668 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-5d5a5f0c-7977-4c42-811b-24546cccd799 admin admin] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:34:25.783139 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-5d5a5f0c-7977-4c42-811b-24546cccd799 admin admin] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:34:25.783554 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-5d5a5f0c-7977-4c42-811b-24546cccd799 admin admin] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:34:25.815641 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-5d5a5f0c-7977-4c42-811b-24546cccd799 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.185932 Sep 27 16:34:25.816193 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 35/70] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Sep 27 16:34:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 16:34:26.929607 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-370a512e-bf84-4033-a7fb-47c6a84a89b4 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:34:26.930598 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-370a512e-bf84-4033-a7fb-47c6a84a89b4 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Sep 27 16:34:26.931016 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 36/71] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Sep 27 16:34:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:34:27.125206 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-11ae89f8-01b8-4bb8-bc63-bd184ae13970 admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:34:27.128667 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-11ae89f8-01b8-4bb8-bc63-bd184ae13970 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:34:27.129144 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-11ae89f8-01b8-4bb8-bc63-bd184ae13970 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:34:27.129561 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-11ae89f8-01b8-4bb8-bc63-bd184ae13970 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:34:27.130263 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-11ae89f8-01b8-4bb8-bc63-bd184ae13970 admin admin] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:34:27.130703 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-11ae89f8-01b8-4bb8-bc63-bd184ae13970 admin admin] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:34:27.131714 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-11ae89f8-01b8-4bb8-bc63-bd184ae13970 admin admin] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:34:27.150923 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-11ae89f8-01b8-4bb8-bc63-bd184ae13970 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.078484 Sep 27 16:34:27.151462 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 36/72] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Sep 27 16:34:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 16:34:38.655895 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-370a512e-bf84-4033-a7fb-47c6a84a89b4 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:34:38.656887 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-370a512e-bf84-4033-a7fb-47c6a84a89b4 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Sep 27 16:34:38.657278 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 37/73] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Sep 27 16:34:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:34:38.801618 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writing DB stats nova_cell0:SELECT=4 {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:34:38.802345 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writing DB stats nova_cell1:SELECT=4 {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:34:38.803083 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG dbcounter [-] [106077] Writing DB stats nova_api:SELECT=8 {{(pid=106077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:34:38.851441 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-11b58fba-81b7-429c-b550-b1981cfe68ce admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:34:38.854872 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-11b58fba-81b7-429c-b550-b1981cfe68ce admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:34:38.855368 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-11b58fba-81b7-429c-b550-b1981cfe68ce admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:34:38.855797 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-11b58fba-81b7-429c-b550-b1981cfe68ce admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:34:38.856503 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-11b58fba-81b7-429c-b550-b1981cfe68ce admin admin] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:34:38.856944 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-11b58fba-81b7-429c-b550-b1981cfe68ce admin admin] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:34:38.857356 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-11b58fba-81b7-429c-b550-b1981cfe68ce admin admin] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:34:38.883070 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-11b58fba-81b7-429c-b550-b1981cfe68ce admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.085666 Sep 27 16:34:38.883556 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 37/74] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Sep 27 16:34:38 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:34:39.973285 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG nova.api.openstack.wsgi [None req-370a512e-bf84-4033-a7fb-47c6a84a89b4 admin admin] Calling method '>' {{(pid=106076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:34:39.974293 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: INFO nova.api.openstack.requestlog [None req-370a512e-bf84-4033-a7fb-47c6a84a89b4 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 27 16:34:39.974687 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: [pid: 106076|app: 0|req: 38/75] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Sep 27 16:34:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:34:40.164702 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG nova.api.openstack.wsgi [None req-5cd9eae2-669b-4796-a182-7ea138c8dc8b admin admin] Calling method '>' {{(pid=106077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:34:40.168292 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-5cd9eae2-669b-4796-a182-7ea138c8dc8b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:34:40.168760 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-5cd9eae2-669b-4796-a182-7ea138c8dc8b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:34:40.169183 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-5cd9eae2-669b-4796-a182-7ea138c8dc8b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:34:40.169888 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-5cd9eae2-669b-4796-a182-7ea138c8dc8b admin admin] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:34:40.170330 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-5cd9eae2-669b-4796-a182-7ea138c8dc8b admin admin] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:34:40.170742 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: DEBUG oslo_concurrency.lockutils [None req-5cd9eae2-669b-4796-a182-7ea138c8dc8b admin admin] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:34:40.191922 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: INFO nova.api.openstack.requestlog [None req-5cd9eae2-669b-4796-a182-7ea138c8dc8b admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.078698 Sep 27 16:34:40.192468 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: [pid: 106077|app: 0|req: 38/76] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Sep 27 16:34:40 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:35:38.530825 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: Tue Sep 27 16:35:38 2022 - graceful shutdown triggered... Sep 27 16:35:38.530978 dv-cinder-855060-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 27 16:35:38.531908 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: Gracefully killing worker 1 (pid: 106076)... Sep 27 16:35:38.532305 dv-cinder-855060-2-iscsi devstack@n-api.service[106077]: Gracefully killing worker 2 (pid: 106077)... Sep 27 16:35:38.669661 dv-cinder-855060-2-iscsi devstack@n-api.service[106076]: DEBUG dbcounter [-] [106076] Writing DB stats nova_api:SELECT=4 {{(pid=106076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:35:39.532970 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: worker 1 buried after 1 seconds Sep 27 16:35:39.532970 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: worker 2 buried after 1 seconds Sep 27 16:35:39.533561 dv-cinder-855060-2-iscsi devstack@n-api.service[106075]: goodbye to uWSGI. Sep 27 16:35:39.534526 dv-cinder-855060-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 27 16:35:39.535134 dv-cinder-855060-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 27 16:35:39.537816 dv-cinder-855060-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 27 16:35:39.555229 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 27 16:35:39.557232 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 27 16:35:39 2022] *** Sep 27 16:35:39.557232 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 27 16:35:39.557232 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 27 16:35:39.557232 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: nodename: dv-cinder-855060-2-iscsi Sep 27 16:35:39.557232 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: machine: x86_64 Sep 27 16:35:39.557232 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: clock source: unix Sep 27 16:35:39.557232 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: pcre jit disabled Sep 27 16:35:39.557232 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: detected number of CPU cores: 4 Sep 27 16:35:39.557232 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: current working directory: / Sep 27 16:35:39.557232 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: detected binary path: /usr/bin/uwsgi-core Sep 27 16:35:39.557232 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: your processes number limit is 47680 Sep 27 16:35:39.558208 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: your memory page size is 4096 bytes Sep 27 16:35:39.558208 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: detected max file descriptor number: 2048 Sep 27 16:35:39.558208 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: lock engine: pthread robust mutexes Sep 27 16:35:39.558208 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: thunder lock: enabled Sep 27 16:35:39.558208 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 27 16:35:39.558208 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 27 16:35:39.596991 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: Python main interpreter initialized at 0x5571e29799c0 Sep 27 16:35:39.596991 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: python threads support enabled Sep 27 16:35:39.596991 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: your server socket listen backlog is limited to 100 connections Sep 27 16:35:39.597251 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: your mercy for graceful operations on workers is 90 seconds Sep 27 16:35:39.597800 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: mapped 403077 bytes (393 KB) for 2 cores Sep 27 16:35:39.597800 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: *** Operational MODE: preforking *** Sep 27 16:35:39.597800 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: *** uWSGI is running in multiple interpreter mode *** Sep 27 16:35:39.597800 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: spawned uWSGI master process (pid: 127598) Sep 27 16:35:39.597901 dv-cinder-855060-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 27 16:35:39.602816 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: spawned uWSGI worker 1 (pid: 127617, cores: 1) Sep 27 16:35:39.602816 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: spawned uWSGI worker 2 (pid: 127618, cores: 1) Sep 27 16:35:39.602816 dv-cinder-855060-2-iscsi devstack@n-api.service[127598]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 27 16:35:40.268745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 27 16:35:40.269338 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 27 16:35:41.436842 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 16:35:41.436842 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: from cryptography.utils import int_from_bytes Sep 27 16:35:41.437529 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 16:35:41.437529 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: from cryptography.utils import int_from_bytes Sep 27 16:35:41.437809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 16:35:41.437809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: from cryptography.utils import int_from_bytes Sep 27 16:35:41.438275 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 16:35:41.438275 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: from cryptography.utils import int_from_bytes Sep 27 16:35:43.873541 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 27 16:35:43.874265 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 27 16:35:43.874366 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 27 16:35:43.874697 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 27 16:35:43.874973 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 27 16:35:43.875361 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.875688 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.876008 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.876328 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.876660 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.876970 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.877290 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.877608 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.877940 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.878204 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.878520 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.879025 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855060-2-iscsi {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.879350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.879659 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.879972 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.880292 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.880832 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.881158 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.881480 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.881984 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.883464 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.883464 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.883464 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.883773 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.883989 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.884453 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.884781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.885094 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.885425 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.886300 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.886713 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855060-2-iscsi {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.887058 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.887391 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.887692 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.888129 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.888438 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.888750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.889078 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.889392 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.889700 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.890026 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.890346 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.890662 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.891007 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.891310 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.891617 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.891926 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.892246 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.892551 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.892854 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.893103 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.893410 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.893729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.894049 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.894367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.894616 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.894887 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.895207 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.895449 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 27 16:35:43.895869 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.895965 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 27 16:35:43.896115 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.896115 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.896294 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 27 16:35:43.896445 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.896582 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 27 16:35:43.896687 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.896837 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 27 16:35:43.896993 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.897231 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.897324 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.897562 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.897675 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.897885 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.897980 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.898197 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.898290 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.898515 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.898618 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.898880 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.898996 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.899157 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.899249 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.899475 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.899579 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.899800 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.899903 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.900061 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.900155 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.900377 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.900480 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.900725 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.900825 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855060-2-iscsi {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.901041 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.901142 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.901993 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.902196 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.902342 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.902456 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.903198 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.903325 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.903422 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.903517 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.903610 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.903702 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.903787 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.903887 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.903986 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.904156 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.904271 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.904456 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.904600 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.904698 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.904793 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.904994 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.905094 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.905301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.905394 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.905618 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.905721 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.905925 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.906026 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.906232 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.906336 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.906539 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.906639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.906881 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.906981 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.907167 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.907271 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.907474 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.907593 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855060-2-iscsi {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.907778 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.907875 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.908088 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.908190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.908392 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.908501 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.908696 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.908885 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.908986 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.909198 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.909344 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.909508 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.909600 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.909829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.909923 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.910150 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.910251 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.910456 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.910548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.910764 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.910897 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.911090 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.911183 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.911395 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.911495 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.911703 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.911803 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.912004 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.912094 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.912311 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.912411 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.912615 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.912716 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.912930 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.913030 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.913233 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.913341 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.913534 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.913639 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.913782 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.913874 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.914090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.914190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.914409 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.914881 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.915016 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.915126 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.915316 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.915415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.915574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.915666 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.915823 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.915931 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.916141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.916242 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.916461 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.916554 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.916770 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.916871 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.917134 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.917274 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.917439 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.917617 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.917744 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.917935 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.918052 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.918249 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.918342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.918562 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.918674 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.918898 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.918995 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.919209 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.919352 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.919527 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.919674 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.919845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.919947 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.920145 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.920236 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.920462 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.920563 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.920780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.920879 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.921115 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.921207 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.921417 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.921517 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.921728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.921821 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.922067 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.922167 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.922384 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.922478 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.922692 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.922873 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.923026 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.923129 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.923339 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.923433 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.923646 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.923737 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.923951 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.924128 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.924257 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.924357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.924565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.924658 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.924881 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.925034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.925184 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.925276 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.925433 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.925526 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.925733 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.925837 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.926036 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.926130 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.926354 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.926457 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.926661 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.926762 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.926991 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.927098 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.927304 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.927396 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.927604 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.927698 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.927910 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.928001 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.928216 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.928308 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.928521 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.928665 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.928825 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.928924 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.929131 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.929253 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.929437 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.929576 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.929740 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.929888 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.930046 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.930198 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.930349 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.930507 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.930651 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.930872 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.930992 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.931182 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.931314 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.931495 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.931621 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.931814 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.931931 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.932126 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.932226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.932448 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.932584 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.932867 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.932960 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.933175 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.933362 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.933482 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.933682 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.933803 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.933999 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.934093 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.934311 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.934402 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.934650 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.934744 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.934992 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.935131 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.935319 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.935420 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.935635 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.935741 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.935950 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.936050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.936269 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.936369 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.936581 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.936686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.936889 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.937027 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.937197 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.937313 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.937506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.937643 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.937810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.937913 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.938106 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.938216 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.938444 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.938572 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.938696 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.938809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.939029 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.939147 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.939332 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.939432 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.939652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.939780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.939972 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.940083 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.940279 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.940389 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.940584 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.940685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.940889 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.941005 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.941194 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.941304 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 16:35:43.941500 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.941603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.941815 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.941940 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.942129 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.942232 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.942432 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.942540 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.942753 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.942908 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.943094 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.943196 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.943389 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.943489 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.943711 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.943825 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.944017 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.944116 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.944322 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.944429 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.944634 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.944751 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.944943 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.945052 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.945292 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.945393 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.945605 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.945715 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.945857 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.945951 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.946178 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.946286 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.946489 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.946589 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.946814 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.946916 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.947155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.947256 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.947447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.947548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.947764 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.947864 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.948085 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.948730 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.948978 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.949323 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.949692 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.950040 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.950352 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.950680 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.950807 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.951033 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.951133 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.951348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.951447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.951643 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.951728 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.951993 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.952105 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.952369 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.952530 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.952687 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.952842 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.952990 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.953142 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.953296 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.953450 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.953596 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.953762 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.953923 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.954076 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.954234 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.954388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.954535 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.954687 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.954872 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.955035 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.955180 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.955358 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.955614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.955841 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.956003 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.956157 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.956302 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.956459 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.956605 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.956821 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.956968 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.957229 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.957468 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.957626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.957772 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.957917 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.958073 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.958227 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.958384 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.958537 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.958682 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.958864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.959017 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.959170 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.959324 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.959481 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.959627 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.959771 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.959914 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.960153 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.960336 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.960562 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.960713 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.960864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.961018 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.961170 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.961326 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.961472 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.961624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.961776 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.961929 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.962084 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.962270 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.962600 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.962759 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.962936 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.963093 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.963251 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.963406 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.963551 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.963695 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.964504 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.964681 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.964865 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.964865 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.965220 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.965368 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.965522 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.965787 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.966037 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.966195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.966349 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.966504 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.966657 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.966884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.967041 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.967194 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.967347 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.967591 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.967755 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.967911 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.968057 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.968201 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.968352 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.968497 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.968651 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.968651 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.968946 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.969098 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.969244 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.969408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.969561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.969717 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.969869 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.970020 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.970020 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.970020 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.970020 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.970020 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.970020 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.971076 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.971231 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.971386 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.971553 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.971707 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.971853 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.971997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.972140 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.972283 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.972283 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.972283 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.972898 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.973045 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.973197 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.973341 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.973499 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.973665 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.973665 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.973952 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.974105 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.974267 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.974428 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.974586 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.974730 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.974922 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.975076 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.975230 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.975522 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.975835 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.976156 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.976476 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.976782 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.977136 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.977306 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.977459 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.977629 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.977854 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.978018 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.978189 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.978342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.978495 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.978663 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.978862 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.979032 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.979187 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.979339 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.979537 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.979766 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.979938 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.980099 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.980261 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.980577 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.980894 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.981210 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.981519 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.981688 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.981842 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.981993 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.982143 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.982302 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.982454 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.982618 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.982931 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.983091 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.983256 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.983418 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.983584 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.983749 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.983908 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.984060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.984217 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.984370 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.984605 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.984605 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.984920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.985073 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.985223 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.985385 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.985559 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.985720 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.985911 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.986160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.986389 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.986389 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.986696 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.986696 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.987020 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.987182 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.987342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.987494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.987659 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.987845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.988077 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.988257 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.988410 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.988574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.988741 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.988895 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.989053 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.989218 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.989378 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.989538 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.989690 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.989842 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.989993 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.990165 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.990325 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.990483 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.990724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.990724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.991181 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.991342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.991494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.991646 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.991797 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.991948 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.992207 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.992367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.992530 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.992690 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.992845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.993110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.993285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.993448 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.993601 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.993759 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.993876 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.993977 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.994079 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.994168 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.994253 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.994345 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.994437 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.994536 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.994622 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.994714 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.994851 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.994949 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.995554 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.995695 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.995849 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.995970 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.996156 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.996280 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.996462 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.996606 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.996805 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.996932 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.997111 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.997269 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.997448 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.997592 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.997776 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.997914 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.998118 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.998235 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.998422 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.998553 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.998728 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.998894 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.999075 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.999217 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.999381 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.999546 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.999747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.999850 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:43.999974 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.000170 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.000278 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.000488 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.000593 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.000813 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.000913 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.001133 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.001224 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.001446 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.001545 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.001751 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.001922 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.002058 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.002155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.002729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.003206 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.003315 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.003411 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.003524 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.003607 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.003859 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.003967 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.004053 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.004136 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.004233 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.004326 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.004419 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.004504 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.004588 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.004671 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.004763 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.004886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.005083 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.005200 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.005303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.005459 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.005596 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.005809 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.005913 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.006127 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.006221 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.006436 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.006539 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.006759 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.006882 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.007091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.007198 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.007400 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.007505 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.007703 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.007798 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.008023 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.008168 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.008317 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.008409 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.008621 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.008715 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.008922 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.009030 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.009228 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.009322 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.009531 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.009626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.009833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.009941 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.010140 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.010241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.010458 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.010560 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.011509 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.011996 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.012103 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.012190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.012190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.012352 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.012448 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.012598 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.012758 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.012914 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.013064 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.013236 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.013374 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.013563 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.013680 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.013972 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.014158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.014261 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.014503 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.014615 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.014857 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.014981 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.015190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.015315 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.015495 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.015592 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.015945 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.016147 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.016239 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.016332 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.016467 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.016569 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.016727 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.016878 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.017033 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.017151 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.017393 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.017488 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.017700 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.017803 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.018014 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.018115 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.018333 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.018428 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.018645 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.018752 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.019015 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.019135 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.019289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.019390 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.019593 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.019694 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.019902 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.019995 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.020213 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.020325 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.020525 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.020622 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.020819 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.020929 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.021149 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.021259 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.021611 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.021714 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.021799 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.021871 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.022127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.022230 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.022388 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.022473 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.022719 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.022834 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.023032 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.023244 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.023350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.023436 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.023752 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.023870 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.023955 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.024048 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.024367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.024469 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.024543 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.024874 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.024973 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.025059 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.025142 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.025323 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.025417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.025536 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.025663 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.025830 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.025979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.026160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.026366 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.026685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.033731 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.033731 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.033960 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.034049 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.034122 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.034200 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.034306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.034389 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.034487 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.034580 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.034666 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.034753 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.034861 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.034962 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.035056 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.035143 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.035241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.035328 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.035459 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.035556 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.035653 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.035748 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.035835 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.035930 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.036017 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.036101 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.036186 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.036278 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.036364 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.036458 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.036551 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.036654 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.036752 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.036838 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.036923 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.037012 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.037086 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.037177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.037269 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.037269 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.037425 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.037519 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.037606 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.037691 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.037774 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.037858 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.037956 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.038043 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.038135 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.038231 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.038325 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.038419 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.038669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.038797 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.038891 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.038976 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.039073 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.039168 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.039264 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.039351 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.039508 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.039864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.039951 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.040035 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.040133 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.040220 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.040305 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.040398 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.040398 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.040564 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.040651 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.040742 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.040742 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.040897 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.040897 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.041074 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.041169 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.041255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.041346 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.041432 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.041516 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.041609 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.041777 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.041894 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.041994 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.042081 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.042166 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.042261 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.042354 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.042456 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.042635 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.042741 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.042866 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.042955 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.043041 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.043134 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.043228 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.043322 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.043417 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.043511 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.043598 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.043678 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.043763 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.043902 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.044032 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.044129 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.044214 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.044339 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.044440 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.044565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.044669 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.044756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.044849 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.044973 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.045106 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.045219 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.045315 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.045493 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.045599 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.045818 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.045915 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.046130 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.046227 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.046437 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.046530 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.046747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.046910 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.047094 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.047191 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.047402 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.047505 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.047727 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.047821 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.048036 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.048131 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.048344 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.048444 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.048844 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.049014 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.049014 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.049280 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.049422 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.049624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.049624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.049884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.050018 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.050150 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.050289 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.050433 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.050566 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.050713 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.050888 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.051034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.051167 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.051306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.051447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.051657 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.051801 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.051942 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.052086 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.052221 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.052367 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.052509 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.052642 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.052780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.052927 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.053074 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.053218 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.053353 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.053537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.053676 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.053845 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.053990 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.054159 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.054293 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.054476 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.054613 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.054811 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.054953 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.055129 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.055276 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.055450 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.055585 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.055762 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.055907 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.056079 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.056216 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.056387 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.056521 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.056704 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.056845 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.057017 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.057161 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.057303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.057449 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.058193 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.058360 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.058711 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.058898 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.062358 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.062565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.062676 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.062766 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.062992 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.063082 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.063082 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.063258 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.063346 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.063431 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.063524 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.063618 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.063712 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.063812 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.063900 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.063985 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.064078 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.064220 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.064323 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.064465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.064598 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.064697 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.064823 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.064926 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.065023 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.065118 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.065253 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.065355 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.065451 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.065577 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.065682 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.065770 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.065863 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.065950 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.066035 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.066128 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.066224 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.066320 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.066407 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.066499 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.066594 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.066681 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.066798 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.066901 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.066998 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.067092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.067187 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.067290 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.067440 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.067531 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.067617 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.067710 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.067797 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.067899 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.067987 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.068096 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.068193 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.068324 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.068438 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.068537 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.068613 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.068697 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.068839 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.068938 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.069157 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.069276 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.069469 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.069578 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.069782 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.069878 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.070099 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.070195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.070413 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.070508 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.070724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.070840 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.071058 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.071156 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.071369 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.071493 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.071709 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.071845 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.072096 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.072233 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.072418 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.072564 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.072737 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.072887 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.073065 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.073256 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.074004 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.074154 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.074323 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.074537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.074671 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.074876 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.075012 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.075144 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.075289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.075432 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.075570 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.075702 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.075893 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.076031 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.076209 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.076347 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.076533 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.076671 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.076856 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.076992 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.077168 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.077312 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.077477 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.077619 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.077771 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.077912 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.078088 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.078234 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.078399 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.078544 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.078709 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.078879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.079047 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.079207 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.079428 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.079573 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.079715 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.079859 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.080000 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.080133 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.080279 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.080419 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.080596 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.080747 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.080890 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.081023 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.081204 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.081348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.081516 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.081723 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.081870 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.082043 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.082796 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.082956 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.083104 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.083247 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.083381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.083512 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.083644 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.083783 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.083931 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.084073 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.084206 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.084347 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.084480 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.084617 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.084748 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.084880 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.085001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.085131 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.085270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.085412 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.085558 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.085691 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.085838 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.085972 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.086105 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.086251 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.086385 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.086516 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.086655 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.086847 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.087007 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.087153 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.087295 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.087434 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.087578 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.087756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.087901 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.088071 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.088216 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.088382 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.088520 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.088703 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.088871 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.089039 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.089175 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.089354 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.089580 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.089718 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.089860 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.089993 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.090134 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.090267 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.090407 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.090548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.090691 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.090881 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.091021 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.091186 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.091324 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.091489 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.091636 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.091800 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.091937 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.092113 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.092271 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.092417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.092599 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.092744 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.092923 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.093149 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.093297 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.093446 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.093587 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.093725 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.093869 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.094002 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.094169 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.094314 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.094482 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.094616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.094849 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.094990 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.095110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.095259 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.095393 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.095526 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.095686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.095823 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.095999 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.096267 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.096410 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.096605 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.096742 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.096927 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.097073 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.097247 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.097382 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.097565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.097701 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.097884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.098035 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.098194 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.098335 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.098505 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.098648 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.098824 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.098978 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.099121 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.099252 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.099431 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.099583 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.099812 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.099948 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.100087 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.100218 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.100348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.100478 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.100640 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.100778 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.100986 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.101122 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.101301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.101435 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.101652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.101834 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.101970 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.102175 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.102318 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.102498 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.102642 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.102838 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.102988 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.103176 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.103310 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.103525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.103667 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.103799 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.103930 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.104061 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.104190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.104419 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.104566 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.104818 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.104961 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.105223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.105365 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.105539 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.105681 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.105851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.105995 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.106161 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.106310 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.106472 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.106607 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.106801 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.106952 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.107114 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.107264 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.107425 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.107569 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.107736 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.107864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.108045 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.108182 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.108351 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.108487 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.108659 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.108892 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.109036 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.109211 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.109339 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.109550 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.109687 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.109904 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.110055 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.110199 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.110339 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.110502 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.110639 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.110842 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.110981 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.111156 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.111294 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.111465 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.111614 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.111758 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.111899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.112073 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.112211 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.112388 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.112541 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.112727 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.112862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.112996 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.113139 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.113306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.113443 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.113617 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.113777 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.113941 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.114077 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.114258 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.114406 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.114632 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.114826 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.114979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.115170 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.115318 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.115492 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.115616 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.115852 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.116009 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.116145 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.116285 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.116456 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.116594 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.116768 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.116904 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.117095 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.117241 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.117410 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.117555 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.117721 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.117858 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.118035 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.118179 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.118340 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.118476 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.118645 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.118799 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.118978 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.119132 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.119295 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.119428 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.119602 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.119745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.119894 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.120683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.120833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.120968 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.121107 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.121240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.121388 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.121530 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.121670 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.121814 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.121947 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.122079 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.122224 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.122387 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.122532 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.122705 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.122883 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.123030 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.123177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.123341 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.123477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.123699 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.123845 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.123978 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.124121 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.124267 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.124399 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.124539 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.124687 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.124832 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.124963 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.125165 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.125296 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.125418 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.125561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.125720 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.125990 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.126140 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.126281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.126414 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.126555 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.126697 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.126877 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.127016 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.127189 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.127327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.127499 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.127645 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.127821 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.127957 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.128137 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.128275 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.128465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.128603 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.128785 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.128919 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.129099 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.129236 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.129405 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.129542 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.129736 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.129880 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.130044 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.130289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.130436 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.130670 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.130850 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.130986 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.131126 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.131266 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.131412 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.131568 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.131712 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.131898 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.132041 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.132222 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.132360 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.132525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.132662 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.132849 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.132993 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.133211 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.133327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.133465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.133561 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.133778 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.133870 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.134090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.134184 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.134411 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.134506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.134719 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.134882 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.135058 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.135164 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.135369 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.135478 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.135726 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.136377 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.136531 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.136669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.136848 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.137001 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.137163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.137310 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.137477 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.137614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.137789 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.137925 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.138110 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.138248 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.138456 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.138602 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.138823 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.138978 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.139123 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.139272 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.139437 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.139584 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.139761 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.139906 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.140078 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.140228 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.140374 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.140513 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.140694 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.140930 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.141075 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.141210 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.141342 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.141482 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.141645 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.141793 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.141935 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.142074 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.142218 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 27 16:35:44.142360 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.142677 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.143084 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.143412 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.143742 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.144058 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.144394 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.144725 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.145043 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.145369 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.145685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.146021 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.146364 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.146700 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.147055 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.147367 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.147679 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.147991 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.148306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.148630 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.148943 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.149251 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.149559 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.149870 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.150181 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.150489 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.150811 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.151124 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.151472 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.151850 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.152089 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.152397 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.152703 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.153009 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.153314 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.153626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.153933 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.154249 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.154555 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.154887 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.155197 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.155533 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.155869 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.156186 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.156572 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.156823 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.157146 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.157459 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.157785 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.158110 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.158429 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.158827 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.159168 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.159483 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.159802 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.160119 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.160433 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.160746 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.161080 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.161383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.161711 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.162021 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.162348 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.162672 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.163025 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.163345 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.163663 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.164000 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.164316 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.164899 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.165215 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.165532 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.165847 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.166170 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.166487 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.166821 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.167245 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.167569 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.167902 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.168231 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.168547 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.168876 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.169206 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.169556 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.169873 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.170222 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.170590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.170940 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.171262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.171570 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 16:35:44.171816 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 27 16:35:44.204013 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO dbcounter [None req-e865d34a-ffbe-405a-949d-2b323b8367e8 None None] Registered counter for database nova_api Sep 27 16:35:44.224643 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_db.sqlalchemy.engines [None req-e865d34a-ffbe-405a-949d-2b323b8367e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 16:35:44.232057 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writer thread running {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 16:35:44.234665 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO dbcounter [None req-aa29f5ed-0b64-4fef-afa6-e19ae46b24e9 None None] Registered counter for database nova_api Sep 27 16:35:44.254614 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_db.sqlalchemy.engines [None req-aa29f5ed-0b64-4fef-afa6-e19ae46b24e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 16:35:44.261313 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writer thread running {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 16:35:44.287623 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.context [None req-e865d34a-ffbe-405a-949d-2b323b8367e8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0c749112-4e30-414e-83db-5e002ec73710(cell1) {{(pid=127617) load_cells /opt/stack/nova/nova/context.py:464}} Sep 27 16:35:44.291885 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e865d34a-ffbe-405a-949d-2b323b8367e8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:35:44.292971 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e865d34a-ffbe-405a-949d-2b323b8367e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:35:44.294532 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e865d34a-ffbe-405a-949d-2b323b8367e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:35:44.295284 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e865d34a-ffbe-405a-949d-2b323b8367e8 None None] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:35:44.295731 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e865d34a-ffbe-405a-949d-2b323b8367e8 None None] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:35:44.297730 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e865d34a-ffbe-405a-949d-2b323b8367e8 None None] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:35:44.299750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO dbcounter [None req-e865d34a-ffbe-405a-949d-2b323b8367e8 None None] Registered counter for database nova_cell0 Sep 27 16:35:44.303787 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO dbcounter [None req-e865d34a-ffbe-405a-949d-2b323b8367e8 None None] Registered counter for database nova_cell1 Sep 27 16:35:44.312585 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_db.sqlalchemy.engines [None req-e865d34a-ffbe-405a-949d-2b323b8367e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 16:35:44.313323 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_db.sqlalchemy.engines [None req-e865d34a-ffbe-405a-949d-2b323b8367e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 16:35:44.320288 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writer thread running {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 16:35:44.321550 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writer thread running {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 16:35:44.322730 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.context [None req-aa29f5ed-0b64-4fef-afa6-e19ae46b24e9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0c749112-4e30-414e-83db-5e002ec73710(cell1) {{(pid=127618) load_cells /opt/stack/nova/nova/context.py:464}} Sep 27 16:35:44.327322 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa29f5ed-0b64-4fef-afa6-e19ae46b24e9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:35:44.327810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa29f5ed-0b64-4fef-afa6-e19ae46b24e9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:35:44.329427 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa29f5ed-0b64-4fef-afa6-e19ae46b24e9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:35:44.330181 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa29f5ed-0b64-4fef-afa6-e19ae46b24e9 None None] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:35:44.330641 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa29f5ed-0b64-4fef-afa6-e19ae46b24e9 None None] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:35:44.332691 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa29f5ed-0b64-4fef-afa6-e19ae46b24e9 None None] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:35:44.334705 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO dbcounter [None req-aa29f5ed-0b64-4fef-afa6-e19ae46b24e9 None None] Registered counter for database nova_cell0 Sep 27 16:35:44.339348 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO dbcounter [None req-aa29f5ed-0b64-4fef-afa6-e19ae46b24e9 None None] Registered counter for database nova_cell1 Sep 27 16:35:44.346846 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_db.sqlalchemy.engines [None req-aa29f5ed-0b64-4fef-afa6-e19ae46b24e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 16:35:44.351573 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_db.sqlalchemy.engines [None req-aa29f5ed-0b64-4fef-afa6-e19ae46b24e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 16:35:44.358391 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writer thread running {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 16:35:44.360556 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writer thread running {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 16:35:44.469866 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO dbcounter [None req-e865d34a-ffbe-405a-949d-2b323b8367e8 None None] Registered counter for database nova_cell0 Sep 27 16:35:44.476711 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_db.sqlalchemy.engines [None req-e865d34a-ffbe-405a-949d-2b323b8367e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 16:35:44.481370 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writer thread running {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 16:35:44.508072 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO dbcounter [None req-aa29f5ed-0b64-4fef-afa6-e19ae46b24e9 None None] Registered counter for database nova_cell0 Sep 27 16:35:44.515489 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_db.sqlalchemy.engines [None req-aa29f5ed-0b64-4fef-afa6-e19ae46b24e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 16:35:44.520267 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writer thread running {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 16:35:44.799728 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: WARNING keystonemiddleware.auth_token [None req-e865d34a-ffbe-405a-949d-2b323b8367e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 16:35:44.806924 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: WARNING keystonemiddleware.auth_token [None req-e865d34a-ffbe-405a-949d-2b323b8367e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 16:35:44.843221 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: WARNING keystonemiddleware.auth_token [None req-aa29f5ed-0b64-4fef-afa6-e19ae46b24e9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 16:35:44.850588 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: WARNING keystonemiddleware.auth_token [None req-aa29f5ed-0b64-4fef-afa6-e19ae46b24e9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 16:35:45.155623 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: WARNING keystonemiddleware.auth_token [None req-e865d34a-ffbe-405a-949d-2b323b8367e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 16:35:45.161618 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: WARNING keystonemiddleware.auth_token [None req-e865d34a-ffbe-405a-949d-2b323b8367e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 16:35:45.167756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5571e29799c0 pid: 127617 (default app) Sep 27 16:35:45.199311 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: WARNING keystonemiddleware.auth_token [None req-aa29f5ed-0b64-4fef-afa6-e19ae46b24e9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 16:35:45.205364 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: WARNING keystonemiddleware.auth_token [None req-aa29f5ed-0b64-4fef-afa6-e19ae46b24e9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 16:35:45.210671 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5571e29799c0 pid: 127618 (default app) Sep 27 16:36:23.095603 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:23.096392 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:23.097156 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:23.098184 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:24.519497 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c175c6da-1d05-42c0-9aad-a0f32ad8a806 tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Action: 'create', calling method: .version_select at 0x7fa406839550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1556253356"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:36:26.995614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c175c6da-1d05-42c0-9aad-a0f32ad8a806 tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.911205 Sep 27 16:36:26.996231 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 1/1] 10.222.0.64 () {60 vars in 1155 bytes} [Tue Sep 27 16:36:23 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3914 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 27 16:36:27.031170 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:27.032118 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:27.038591 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:27.042176 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:27.442112 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d69b3200-e55a-48d7-90f0-3b1bf6d5190e tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Calling method '.version_select at 0x7fa406886310>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:28.564660 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d69b3200-e55a-48d7-90f0-3b1bf6d5190e tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/76f20314-78ff-4f81-8f9d-dc843a293f22" status: 200 len: 346 microversion: 2.1 time: 1.550734 Sep 27 16:36:28.566271 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 1/2] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Sep 27 16:36:27 2022] GET /compute/v2.1/os-volumes/76f20314-78ff-4f81-8f9d-dc843a293f22 => generated 346 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:36:28.594619 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2ed4560a-91f4-4447-ae6a-980f4046b31c tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Action: 'create', calling method: .version_select at 0x7fa40670e3a0>, body: {"snapshot": {"volume_id": "76f20314-78ff-4f81-8f9d-dc843a293f22", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1857576209"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:36:29.666937 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2ed4560a-91f4-4447-ae6a-980f4046b31c tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] 10.222.0.64 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.088780 Sep 27 16:36:29.685835 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 2/3] 10.222.0.64 () {60 vars in 1162 bytes} [Tue Sep 27 16:36:28 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:36:29.698456 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-052681ab-cf91-4e18-af18-0b752f0873b2 tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Calling method '.version_select at 0x7fa40674f3a0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:29.995254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-052681ab-cf91-4e18-af18-0b752f0873b2 tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/8b087e90-d04e-4103-8cc6-2db5466a1553" status: 200 len: 287 microversion: 2.1 time: 0.301999 Sep 27 16:36:30.001964 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1251 bytes} [Tue Sep 27 16:36:29 2022] GET /compute/v2.1/os-snapshots/8b087e90-d04e-4103-8cc6-2db5466a1553 => generated 287 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:36:30.025733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-23012321-5ed2-402b-8aec-e6457c3211ac tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Calling method '.version_select at 0x7fa4066a3670>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:30.409209 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-23012321-5ed2-402b-8aec-e6457c3211ac tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.405596 Sep 27 16:36:30.410409 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 3/5] 10.222.0.64 () {58 vars in 1140 bytes} [Tue Sep 27 16:36:30 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:36:30.423301 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-49854a85-7e75-4a99-8f7c-3f9b8b6f85fc tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Calling method '.version_select at 0x7fa40674faf0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:30.631248 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-49854a85-7e75-4a99-8f7c-3f9b8b6f85fc tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/8b087e90-d04e-4103-8cc6-2db5466a1553" status: 200 len: 287 microversion: 2.1 time: 0.207199 Sep 27 16:36:30.631248 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 3/6] 10.222.0.64 () {58 vars in 1251 bytes} [Tue Sep 27 16:36:30 2022] GET /compute/v2.1/os-snapshots/8b087e90-d04e-4103-8cc6-2db5466a1553 => generated 287 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:36:31.647444 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e15d1c11-4c0b-4c15-8cb2-01d1eb69ee2a tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Calling method '.version_select at 0x7fa4066a3c10>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:31.752722 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e15d1c11-4c0b-4c15-8cb2-01d1eb69ee2a tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/8b087e90-d04e-4103-8cc6-2db5466a1553" status: 200 len: 287 microversion: 2.1 time: 0.114818 Sep 27 16:36:31.753838 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1251 bytes} [Tue Sep 27 16:36:31 2022] GET /compute/v2.1/os-snapshots/8b087e90-d04e-4103-8cc6-2db5466a1553 => generated 287 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:36:32.530451 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5f2d6a81-ccac-4161-9307-f02077eda4ba tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1548702592", "imageRef": "6908a343-46fa-4801-bfb5-7ad92ac26956", "flavorRef": "452", "networks": [{"uuid": "6dde6306-738e-4712-a96b-a15f6cb9b5d1"}]}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:36:32.725216 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-5f2d6a81-ccac-4161-9307-f02077eda4ba tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] validate_networks() for [('6dde6306-738e-4712-a96b-a15f6cb9b5d1', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 16:36:32.767393 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9b56a796-232a-43e4-8eed-60f370fcce3f tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Calling method '.version_select at 0x7fa4066a34c0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:32.831588 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9b56a796-232a-43e4-8eed-60f370fcce3f tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/8b087e90-d04e-4103-8cc6-2db5466a1553" status: 200 len: 287 microversion: 2.1 time: 0.068835 Sep 27 16:36:32.832893 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 5/8] 10.222.0.64 () {58 vars in 1251 bytes} [Tue Sep 27 16:36:32 2022] GET /compute/v2.1/os-snapshots/8b087e90-d04e-4103-8cc6-2db5466a1553 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:36:33.848626 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e74033ab-c5a2-4cdf-aa13-72f95d48c604 tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Calling method '.version_select at 0x7fa40670ef70>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:33.947762 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e74033ab-c5a2-4cdf-aa13-72f95d48c604 tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/8b087e90-d04e-4103-8cc6-2db5466a1553" status: 200 len: 288 microversion: 2.1 time: 0.105772 Sep 27 16:36:33.949365 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 6/9] 10.222.0.64 () {58 vars in 1251 bytes} [Tue Sep 27 16:36:33 2022] GET /compute/v2.1/os-snapshots/8b087e90-d04e-4103-8cc6-2db5466a1553 => generated 288 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:36:33.969080 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c0d58f37-5b4c-49a2-bffe-bfc779d2c9da tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Calling method '.version_select at 0x7fa4066a3160>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:34.175667 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c0d58f37-5b4c-49a2-bffe-bfc779d2c9da tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] 10.222.0.64 "DELETE /compute/v2.1/os-snapshots/8b087e90-d04e-4103-8cc6-2db5466a1553" status: 202 len: 0 microversion: 2.1 time: 0.208187 Sep 27 16:36:34.175667 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 7/10] 10.222.0.64 () {58 vars in 1254 bytes} [Tue Sep 27 16:36:33 2022] DELETE /compute/v2.1/os-snapshots/8b087e90-d04e-4103-8cc6-2db5466a1553 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:36:34.186687 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1284c1bf-e021-48dc-a798-615fbcaf9e46 tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Calling method '.version_select at 0x7fa4066a3a60>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:34.212298 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-5f2d6a81-ccac-4161-9307-f02077eda4ba tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 16:36:34.212298 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-5f2d6a81-ccac-4161-9307-f02077eda4ba tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 16:36:34.212298 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-5f2d6a81-ccac-4161-9307-f02077eda4ba tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 16:36:34.212298 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-5f2d6a81-ccac-4161-9307-f02077eda4ba tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 16:36:34.212298 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-5f2d6a81-ccac-4161-9307-f02077eda4ba tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 16:36:34.302254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f2d6a81-ccac-4161-9307-f02077eda4ba tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:34.303799 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f2d6a81-ccac-4161-9307-f02077eda4ba tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:34.305997 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f2d6a81-ccac-4161-9307-f02077eda4ba tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:34.330217 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f2d6a81-ccac-4161-9307-f02077eda4ba tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:34.331439 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f2d6a81-ccac-4161-9307-f02077eda4ba tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:34.333190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f2d6a81-ccac-4161-9307-f02077eda4ba tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:34.357439 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1284c1bf-e021-48dc-a798-615fbcaf9e46 tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/8b087e90-d04e-4103-8cc6-2db5466a1553" status: 200 len: 287 microversion: 2.1 time: 0.177781 Sep 27 16:36:34.358921 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 8/11] 10.222.0.64 () {58 vars in 1251 bytes} [Tue Sep 27 16:36:34 2022] GET /compute/v2.1/os-snapshots/8b087e90-d04e-4103-8cc6-2db5466a1553 => generated 287 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:36:34.465996 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-5f2d6a81-ccac-4161-9307-f02077eda4ba tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Getting quotas for project 996f7fb4be7b42ceb08488b812087543. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:36:34.481297 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-5f2d6a81-ccac-4161-9307-f02077eda4ba tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Getting quotas for user 02e263a6105642c1815e1c59429278f7 and project 996f7fb4be7b42ceb08488b812087543. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:36:34.512323 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5f2d6a81-ccac-4161-9307-f02077eda4ba tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 16:36:34.515554 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5f2d6a81-ccac-4161-9307-f02077eda4ba tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6908a343-46fa-4801-bfb5-7ad92ac26956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 16:36:34.817550 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5f2d6a81-ccac-4161-9307-f02077eda4ba tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.922657 Sep 27 16:36:34.833440 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dd34f246-3666-4da6-922d-f307f73228d8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:34.834304 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-dd34f246-3666-4da6-922d-f307f73228d8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:34.847308 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 4/12] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Sep 27 16:36:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 16:36:35.136036 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dd34f246-3666-4da6-922d-f307f73228d8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:35.160699 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-dd34f246-3666-4da6-922d-f307f73228d8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1215 microversion: 2.1 time: 0.331588 Sep 27 16:36:35.162824 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 9/13] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:34 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1215 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:36:35.376182 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6c63bb43-f50f-4194-9f0f-e4baf0b23043 tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Calling method '.version_select at 0x7fa405db4550>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:35.448629 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-6c63bb43-f50f-4194-9f0f-e4baf0b23043 tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] HTTP exception thrown: Snapshot 8b087e90-d04e-4103-8cc6-2db5466a1553 could not be found. Sep 27 16:36:35.453188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6c63bb43-f50f-4194-9f0f-e4baf0b23043 tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Request method failure captured: Sep 27 16:36:35.453188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/os-snapshots/8b087e90-d04e-4103-8cc6-2db5466a1553 HTTP/1.1 Sep 27 16:36:35.453188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:36:35.453188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:36:35.453188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:36:35.453188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:36:35.453188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:36:35.453188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:36:35.453188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:36:35.453188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:36:35.453188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMyaHZXSZP9Bpg_cEBbo4I-eoHl4QukZwUdhC0FMuUOE_UcLyS3axEx3FGHHqiCv-2Rs3wxscr24oLZS1aqHouLCwzr9sZlusaHgI6t4oKf8MdCmlx2741msi8_xlIfoz5fl0Gq39vXokJ_sxiVMtgcMp2JI_qXuX9en9CUxGyn92fqs Sep 27 16:36:35.453188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:36:35.453188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:36:35.453188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:36:35.453188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:36:35.453188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:36:35.453188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:36:35.453188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 36c1390c5c194a13b1801a9ef3cd1345 Sep 27 16:36:35.453188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1314861047 Sep 27 16:36:35.453188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:36:35.453188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:36:35.454625 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/36c1390c5c194a13b1801a9ef3cd1345"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_36c1390c5c194a13b1801a9ef3cd1345"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/36c1390c5c194a13b1801a9ef3cd1345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/36c1390c5c194a13b1801a9ef3cd1345"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:36:35.454625 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1314861047 Sep 27 16:36:35.454625 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 36c1390c5c194a13b1801a9ef3cd1345 Sep 27 16:36:35.454625 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1314861047 Sep 27 16:36:35.454625 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesSnapshotsTestJSON-1314861047-project Sep 27 16:36:35.454625 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:36:35.454625 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:36:35.454625 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: b56c499872464f3c9e491e0b28114dfd Sep 27 16:36:35.454625 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1314861047-project Sep 27 16:36:35.454625 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: Sep 27 16:36:35.454625 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Snapshot 8b087e90-d04e-4103-8cc6-2db5466a1553 could not be found. Sep 27 16:36:35.454625 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': '8b087e90-d04e-4103-8cc6-2db5466a1553'} Sep 27 16:36:35.454625 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:36:35.457241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:36:35.457241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 27 16:36:35.457241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 27 16:36:35.457241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 27 16:36:35.457241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 27 16:36:35.457241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 27 16:36:35.457241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 27 16:36:35.457241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 16:36:35.457241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 16:36:35.457241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 16:36:35.457241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 16:36:35.457241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 16:36:35.457241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 16:36:35.457241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 16:36:35.457241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 16:36:35.457241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8b087e90-d04e-4103-8cc6-2db5466a1553 could not be found. (HTTP 404) (Request-ID: req-f51eb666-bee0-42ea-9efc-c1fafc0d5fea) Sep 27 16:36:35.457241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:36:35.457241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:36:35.458465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:36:35.458465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:36:35.458465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 27 16:36:35.458465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 27 16:36:35.458465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 16:36:35.458465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 16:36:35.458465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 27 16:36:35.458465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 27 16:36:35.458465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 16:36:35.458465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 16:36:35.458465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 27 16:36:35.458465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 27 16:36:35.458465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 27 16:36:35.458465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 27 16:36:35.458465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 27 16:36:35.458465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 27 16:36:35.458465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 16:36:35.458465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 16:36:35.458465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 16:36:35.459652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 16:36:35.459652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 16:36:35.459652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 16:36:35.459652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 16:36:35.459652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 16:36:35.459652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8b087e90-d04e-4103-8cc6-2db5466a1553 could not be found. Sep 27 16:36:35.459652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:36:35.459652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:36:35.459652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:36:35.459652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:36:35.459652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:36:35.459652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:36:35.459652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:36:35.459652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:36:35.459652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 16:36:35.459652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 16:36:35.459652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:36:35.459652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:36:35.459652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 27 16:36:35.459652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:36:35.460935 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8b087e90-d04e-4103-8cc6-2db5466a1553 could not be found. Sep 27 16:36:35.460935 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:36:35.460935 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:36:35.460935 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:36:35.460935 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:36:35.460935 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:36:35.460935 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:36:35.460935 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:36:35.460935 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:36:35.460935 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8b087e90-d04e-4103-8cc6-2db5466a1553 could not be found. Sep 27 16:36:35.460935 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:36:35.460935 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6c63bb43-f50f-4194-9f0f-e4baf0b23043 tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Returning 404 to user: Snapshot 8b087e90-d04e-4103-8cc6-2db5466a1553 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:36:35.460935 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6c63bb43-f50f-4194-9f0f-e4baf0b23043 tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/8b087e90-d04e-4103-8cc6-2db5466a1553" status: 404 len: 111 microversion: 2.1 time: 0.089437 Sep 27 16:36:35.461807 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 5/14] 10.222.0.64 () {58 vars in 1251 bytes} [Tue Sep 27 16:36:35 2022] GET /compute/v2.1/os-snapshots/8b087e90-d04e-4103-8cc6-2db5466a1553 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:36:35.465758 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5e98e8ab-4ea7-49f0-b062-99235c47a2d6 tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Calling method '.version_select at 0x7fa406662dc0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:35.754629 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5e98e8ab-4ea7-49f0-b062-99235c47a2d6 tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/76f20314-78ff-4f81-8f9d-dc843a293f22" status: 202 len: 0 microversion: 2.1 time: 0.294034 Sep 27 16:36:35.760218 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 10/15] 10.222.0.64 () {58 vars in 1248 bytes} [Tue Sep 27 16:36:35 2022] DELETE /compute/v2.1/os-volumes/76f20314-78ff-4f81-8f9d-dc843a293f22 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:36:35.778947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6a630513-bc51-4109-901c-afb50d183e9c tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Calling method '.version_select at 0x7fa405d849d0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:35.949054 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6a630513-bc51-4109-901c-afb50d183e9c tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/76f20314-78ff-4f81-8f9d-dc843a293f22" status: 200 len: 345 microversion: 2.1 time: 0.178771 Sep 27 16:36:35.949955 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 6/16] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Sep 27 16:36:35 2022] GET /compute/v2.1/os-volumes/76f20314-78ff-4f81-8f9d-dc843a293f22 => generated 345 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:36:36.186336 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1bb30373-11ff-4693-93bf-8cce377d9367 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:36.187549 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1bb30373-11ff-4693-93bf-8cce377d9367 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:36.282241 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1bb30373-11ff-4693-93bf-8cce377d9367 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:36.293258 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1bb30373-11ff-4693-93bf-8cce377d9367 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1215 microversion: 2.1 time: 0.111518 Sep 27 16:36:36.297022 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 11/17] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:36 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1215 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:36:36.965287 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a5813ce1-150a-4cfc-b228-617b156def31 tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Calling method '.version_select at 0x7fa405d1f160>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:37.020397 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-a5813ce1-150a-4cfc-b228-617b156def31 tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] HTTP exception thrown: Volume 76f20314-78ff-4f81-8f9d-dc843a293f22 could not be found. Sep 27 16:36:37.025664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a5813ce1-150a-4cfc-b228-617b156def31 tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Request method failure captured: Sep 27 16:36:37.025664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/os-volumes/76f20314-78ff-4f81-8f9d-dc843a293f22 HTTP/1.1 Sep 27 16:36:37.025664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:36:37.025664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:36:37.025664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:36:37.025664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:36:37.025664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:36:37.025664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:36:37.025664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:36:37.025664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:36:37.025664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMyaHZXSZP9Bpg_cEBbo4I-eoHl4QukZwUdhC0FMuUOE_UcLyS3axEx3FGHHqiCv-2Rs3wxscr24oLZS1aqHouLCwzr9sZlusaHgI6t4oKf8MdCmlx2741msi8_xlIfoz5fl0Gq39vXokJ_sxiVMtgcMp2JI_qXuX9en9CUxGyn92fqs Sep 27 16:36:37.025664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:36:37.025664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:36:37.025664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:36:37.025664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:36:37.025664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:36:37.025664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:36:37.025664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 36c1390c5c194a13b1801a9ef3cd1345 Sep 27 16:36:37.025664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1314861047 Sep 27 16:36:37.025664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:36:37.025664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:36:37.027483 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/36c1390c5c194a13b1801a9ef3cd1345"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_36c1390c5c194a13b1801a9ef3cd1345"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/36c1390c5c194a13b1801a9ef3cd1345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/36c1390c5c194a13b1801a9ef3cd1345"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:36:37.027483 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1314861047 Sep 27 16:36:37.027483 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 36c1390c5c194a13b1801a9ef3cd1345 Sep 27 16:36:37.027483 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1314861047 Sep 27 16:36:37.027483 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesSnapshotsTestJSON-1314861047-project Sep 27 16:36:37.027483 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:36:37.027483 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:36:37.027483 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: b56c499872464f3c9e491e0b28114dfd Sep 27 16:36:37.027483 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1314861047-project Sep 27 16:36:37.027483 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: Sep 27 16:36:37.027483 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Volume 76f20314-78ff-4f81-8f9d-dc843a293f22 could not be found. Sep 27 16:36:37.027483 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': '76f20314-78ff-4f81-8f9d-dc843a293f22'} Sep 27 16:36:37.027483 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:36:37.028306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:36:37.028306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 16:36:37.028306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 16:36:37.028306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 16:36:37.028306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 16:36:37.028306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 16:36:37.028306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 16:36:37.028306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 16:36:37.028306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 16:36:37.028306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 16:36:37.028306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 16:36:37.028306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 16:36:37.028306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 16:36:37.028306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 16:36:37.028306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 16:36:37.028306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 76f20314-78ff-4f81-8f9d-dc843a293f22 could not be found. (HTTP 404) (Request-ID: req-eb728304-729c-4e6b-b367-ea13ab548df6) Sep 27 16:36:37.028306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:36:37.028306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:36:37.028306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:36:37.029492 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:36:37.029492 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 27 16:36:37.029492 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 27 16:36:37.029492 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 16:36:37.029492 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 16:36:37.029492 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 27 16:36:37.029492 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 27 16:36:37.029492 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 16:36:37.029492 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 16:36:37.029492 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 16:36:37.029492 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 16:36:37.029492 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 16:36:37.029492 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 16:36:37.029492 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 16:36:37.029492 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 16:36:37.029492 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 16:36:37.029492 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 16:36:37.029492 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 16:36:37.029492 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 16:36:37.030640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 16:36:37.030640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 16:36:37.030640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 16:36:37.030640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 16:36:37.030640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 76f20314-78ff-4f81-8f9d-dc843a293f22 could not be found. Sep 27 16:36:37.030640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:36:37.030640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:36:37.030640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:36:37.030640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:36:37.030640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:36:37.030640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:36:37.030640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:36:37.030640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:36:37.030640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 16:36:37.030640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 16:36:37.030640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:36:37.030640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:36:37.030640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 27 16:36:37.030640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:36:37.031871 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 76f20314-78ff-4f81-8f9d-dc843a293f22 could not be found. Sep 27 16:36:37.031871 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:36:37.031871 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:36:37.031871 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:36:37.031871 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:36:37.031871 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:36:37.031871 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:36:37.031871 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:36:37.031871 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:36:37.031871 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 76f20314-78ff-4f81-8f9d-dc843a293f22 could not be found. Sep 27 16:36:37.031871 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:36:37.037067 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a5813ce1-150a-4cfc-b228-617b156def31 tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Returning 404 to user: Volume 76f20314-78ff-4f81-8f9d-dc843a293f22 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:36:37.039135 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a5813ce1-150a-4cfc-b228-617b156def31 tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/76f20314-78ff-4f81-8f9d-dc843a293f22" status: 404 len: 109 microversion: 2.1 time: 0.078474 Sep 27 16:36:37.048723 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 7/18] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Sep 27 16:36:36 2022] GET /compute/v2.1/os-volumes/76f20314-78ff-4f81-8f9d-dc843a293f22 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:36:37.057274 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0a789cb1-2639-49b5-8150-19149cab529e tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Calling method '.version_select at 0x7fa40666e4c0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:37.148481 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-0a789cb1-2639-49b5-8150-19149cab529e tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] HTTP exception thrown: Volume 76f20314-78ff-4f81-8f9d-dc843a293f22 could not be found. Sep 27 16:36:37.154770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0a789cb1-2639-49b5-8150-19149cab529e tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Request method failure captured: Sep 27 16:36:37.154770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/os-volumes/76f20314-78ff-4f81-8f9d-dc843a293f22 HTTP/1.1 Sep 27 16:36:37.154770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:36:37.154770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:36:37.154770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:36:37.154770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 27 16:36:37.154770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:36:37.154770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:36:37.154770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:36:37.154770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:36:37.154770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMyaHZXSZP9Bpg_cEBbo4I-eoHl4QukZwUdhC0FMuUOE_UcLyS3axEx3FGHHqiCv-2Rs3wxscr24oLZS1aqHouLCwzr9sZlusaHgI6t4oKf8MdCmlx2741msi8_xlIfoz5fl0Gq39vXokJ_sxiVMtgcMp2JI_qXuX9en9CUxGyn92fqs Sep 27 16:36:37.154770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:36:37.154770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:36:37.154770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:36:37.154770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:36:37.154770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:36:37.154770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:36:37.154770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: 36c1390c5c194a13b1801a9ef3cd1345 Sep 27 16:36:37.154770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1314861047 Sep 27 16:36:37.154770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:36:37.154770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:36:37.164599 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/36c1390c5c194a13b1801a9ef3cd1345"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_36c1390c5c194a13b1801a9ef3cd1345"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/36c1390c5c194a13b1801a9ef3cd1345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/36c1390c5c194a13b1801a9ef3cd1345"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:36:37.164599 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1314861047 Sep 27 16:36:37.164599 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 36c1390c5c194a13b1801a9ef3cd1345 Sep 27 16:36:37.164599 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1314861047 Sep 27 16:36:37.164599 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesSnapshotsTestJSON-1314861047-project Sep 27 16:36:37.164599 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:36:37.164599 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:36:37.164599 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: b56c499872464f3c9e491e0b28114dfd Sep 27 16:36:37.164599 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1314861047-project Sep 27 16:36:37.164599 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: Sep 27 16:36:37.164599 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Volume 76f20314-78ff-4f81-8f9d-dc843a293f22 could not be found. Sep 27 16:36:37.164599 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'id': '76f20314-78ff-4f81-8f9d-dc843a293f22'} Sep 27 16:36:37.164599 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:36:37.166067 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:36:37.166067 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 16:36:37.166067 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 16:36:37.166067 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 27 16:36:37.166067 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 27 16:36:37.166067 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 27 16:36:37.166067 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 27 16:36:37.166067 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 27 16:36:37.166067 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 27 16:36:37.166067 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 27 16:36:37.166067 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 27 16:36:37.166067 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 16:36:37.166067 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 16:36:37.166067 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 16:36:37.166067 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 16:36:37.166067 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 76f20314-78ff-4f81-8f9d-dc843a293f22 could not be found. (HTTP 404) (Request-ID: req-acc92d24-3098-41de-8699-0e91f2ae11af) Sep 27 16:36:37.166067 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:36:37.166067 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:36:37.166067 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:36:37.167327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:36:37.167327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 27 16:36:37.167327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 27 16:36:37.167327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 16:36:37.167327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 16:36:37.167327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 27 16:36:37.167327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 27 16:36:37.167327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 16:36:37.167327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 16:36:37.167327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 16:36:37.167327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 16:36:37.167327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 27 16:36:37.167327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 27 16:36:37.167327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 27 16:36:37.167327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 27 16:36:37.167327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 27 16:36:37.167327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 27 16:36:37.167327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 27 16:36:37.167327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 27 16:36:37.168380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 16:36:37.168380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 16:36:37.168380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 16:36:37.168380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 16:36:37.168380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 76f20314-78ff-4f81-8f9d-dc843a293f22 could not be found. Sep 27 16:36:37.168380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:36:37.168380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:36:37.168380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:36:37.168380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:36:37.168380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:36:37.168380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:36:37.168380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:36:37.168380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:36:37.168380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 16:36:37.168380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 16:36:37.168380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:36:37.168380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:36:37.168380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 27 16:36:37.168380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:36:37.169680 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 76f20314-78ff-4f81-8f9d-dc843a293f22 could not be found. Sep 27 16:36:37.169680 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:36:37.169680 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:36:37.169680 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:36:37.169680 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:36:37.169680 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:36:37.169680 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:36:37.169680 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:36:37.169680 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:36:37.169680 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 76f20314-78ff-4f81-8f9d-dc843a293f22 could not be found. Sep 27 16:36:37.169680 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:36:37.169680 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0a789cb1-2639-49b5-8150-19149cab529e tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Returning 404 to user: Volume 76f20314-78ff-4f81-8f9d-dc843a293f22 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:36:37.169680 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0a789cb1-2639-49b5-8150-19149cab529e tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/76f20314-78ff-4f81-8f9d-dc843a293f22" status: 404 len: 109 microversion: 2.1 time: 0.105980 Sep 27 16:36:37.169680 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 12/19] 10.222.0.64 () {58 vars in 1248 bytes} [Tue Sep 27 16:36:37 2022] DELETE /compute/v2.1/os-volumes/76f20314-78ff-4f81-8f9d-dc843a293f22 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:36:37.182159 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c4cc84c9-c296-4298-964d-0d1ab0038fde tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Calling method '.version_select at 0x7fa405d1f4c0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:37.247314 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-c4cc84c9-c296-4298-964d-0d1ab0038fde tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] HTTP exception thrown: Volume 76f20314-78ff-4f81-8f9d-dc843a293f22 could not be found. Sep 27 16:36:37.249528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c4cc84c9-c296-4298-964d-0d1ab0038fde tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Request method failure captured: Sep 27 16:36:37.249528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/os-volumes/76f20314-78ff-4f81-8f9d-dc843a293f22 HTTP/1.1 Sep 27 16:36:37.249528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:36:37.249528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:36:37.249528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:36:37.249528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:36:37.249528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:36:37.249528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:36:37.249528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:36:37.249528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:36:37.249528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMyaHZXSZP9Bpg_cEBbo4I-eoHl4QukZwUdhC0FMuUOE_UcLyS3axEx3FGHHqiCv-2Rs3wxscr24oLZS1aqHouLCwzr9sZlusaHgI6t4oKf8MdCmlx2741msi8_xlIfoz5fl0Gq39vXokJ_sxiVMtgcMp2JI_qXuX9en9CUxGyn92fqs Sep 27 16:36:37.249528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:36:37.249528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:36:37.249528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:36:37.249528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:36:37.249528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:36:37.249528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:36:37.249528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 36c1390c5c194a13b1801a9ef3cd1345 Sep 27 16:36:37.249528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1314861047 Sep 27 16:36:37.249528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:36:37.249528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:36:37.251259 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/36c1390c5c194a13b1801a9ef3cd1345"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_36c1390c5c194a13b1801a9ef3cd1345"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/36c1390c5c194a13b1801a9ef3cd1345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/36c1390c5c194a13b1801a9ef3cd1345"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:36:37.251259 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1314861047 Sep 27 16:36:37.251259 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 36c1390c5c194a13b1801a9ef3cd1345 Sep 27 16:36:37.251259 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1314861047 Sep 27 16:36:37.251259 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesSnapshotsTestJSON-1314861047-project Sep 27 16:36:37.251259 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:36:37.251259 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:36:37.251259 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: b56c499872464f3c9e491e0b28114dfd Sep 27 16:36:37.251259 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1314861047-project Sep 27 16:36:37.251259 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: Sep 27 16:36:37.251259 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Volume 76f20314-78ff-4f81-8f9d-dc843a293f22 could not be found. Sep 27 16:36:37.251259 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': '76f20314-78ff-4f81-8f9d-dc843a293f22'} Sep 27 16:36:37.251259 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:36:37.251962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:36:37.251962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 16:36:37.251962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 16:36:37.251962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 16:36:37.251962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 16:36:37.251962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 16:36:37.251962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 16:36:37.251962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 16:36:37.251962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 16:36:37.251962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 16:36:37.251962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 16:36:37.251962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 16:36:37.251962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 16:36:37.251962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 16:36:37.251962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 16:36:37.251962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 76f20314-78ff-4f81-8f9d-dc843a293f22 could not be found. (HTTP 404) (Request-ID: req-dd73e6fc-ec0d-439e-a93b-529ddfd2ada5) Sep 27 16:36:37.251962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:36:37.251962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:36:37.251962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:36:37.253065 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:36:37.253065 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 27 16:36:37.253065 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 27 16:36:37.253065 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 16:36:37.253065 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 16:36:37.253065 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 27 16:36:37.253065 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 27 16:36:37.253065 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 16:36:37.253065 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 16:36:37.253065 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 16:36:37.253065 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 16:36:37.253065 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 16:36:37.253065 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 16:36:37.253065 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 16:36:37.253065 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 16:36:37.253065 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 16:36:37.253065 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 16:36:37.253065 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 16:36:37.253065 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 16:36:37.254190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 16:36:37.254190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 16:36:37.254190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 16:36:37.254190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 16:36:37.254190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 76f20314-78ff-4f81-8f9d-dc843a293f22 could not be found. Sep 27 16:36:37.254190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:36:37.254190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:36:37.254190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:36:37.254190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:36:37.254190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:36:37.254190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:36:37.254190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:36:37.254190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:36:37.254190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 16:36:37.254190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 16:36:37.254190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:36:37.254190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:36:37.254190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 27 16:36:37.254190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:36:37.255381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 76f20314-78ff-4f81-8f9d-dc843a293f22 could not be found. Sep 27 16:36:37.255381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:36:37.255381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:36:37.255381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:36:37.255381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:36:37.255381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:36:37.255381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:36:37.255381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:36:37.255381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:36:37.255381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 76f20314-78ff-4f81-8f9d-dc843a293f22 could not be found. Sep 27 16:36:37.255381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:36:37.255381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c4cc84c9-c296-4298-964d-0d1ab0038fde tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] Returning 404 to user: Volume 76f20314-78ff-4f81-8f9d-dc843a293f22 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:36:37.256728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c4cc84c9-c296-4298-964d-0d1ab0038fde tempest-VolumesSnapshotsTestJSON-1314861047 tempest-VolumesSnapshotsTestJSON-1314861047-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/76f20314-78ff-4f81-8f9d-dc843a293f22" status: 404 len: 109 microversion: 2.1 time: 0.078275 Sep 27 16:36:37.257509 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 8/20] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Sep 27 16:36:37 2022] GET /compute/v2.1/os-volumes/76f20314-78ff-4f81-8f9d-dc843a293f22 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:36:37.339694 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c757eb84-c514-4499-aab3-13d22de7ca78 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:37.339694 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c757eb84-c514-4499-aab3-13d22de7ca78 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:37.460333 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c757eb84-c514-4499-aab3-13d22de7ca78 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:37.469852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c757eb84-c514-4499-aab3-13d22de7ca78 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1215 microversion: 2.1 time: 0.148734 Sep 27 16:36:37.473384 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 13/21] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:37 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1215 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:36:38.499225 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-67fafcdc-3bf7-4bcc-91e8-4d5e678a3ffe tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:38.500797 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-67fafcdc-3bf7-4bcc-91e8-4d5e678a3ffe tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:38.521120 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67fafcdc-3bf7-4bcc-91e8-4d5e678a3ffe tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:38.521859 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67fafcdc-3bf7-4bcc-91e8-4d5e678a3ffe tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:38.524012 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67fafcdc-3bf7-4bcc-91e8-4d5e678a3ffe tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:38.527438 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67fafcdc-3bf7-4bcc-91e8-4d5e678a3ffe tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:38.528471 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67fafcdc-3bf7-4bcc-91e8-4d5e678a3ffe tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:38.531104 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67fafcdc-3bf7-4bcc-91e8-4d5e678a3ffe tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:38.833997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-67fafcdc-3bf7-4bcc-91e8-4d5e678a3ffe tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:38.848666 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-67fafcdc-3bf7-4bcc-91e8-4d5e678a3ffe tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1219 microversion: 2.1 time: 0.354598 Sep 27 16:36:38.855174 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 14/22] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:38 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1219 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:36:38.882434 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e7f287f9-e4e4-4ae8-ad0b-c849ad95917b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Action: 'create', calling method: .version_select at 0x7fa405d84d30>, body: {"keypair": {"name": "tempest-keypair-2024487446", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgy7g4jAtiXHahx7QN+Cx7+0CdKryBTN032s0yCD0mR28jJkFyqd7NpMvhIQccCRcs+MrmuEBJ+VTdjG6bVtJ9nRayFczoSu94X03KGT2EMJWdAB+2FIsELzn7y0tXCQw=="}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:36:38.927280 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-e7f287f9-e4e4-4ae8-ad0b-c849ad95917b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Getting quotas for project 41cca09950c34cc7baded0eb0a42bb07. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:36:38.931707 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-e7f287f9-e4e4-4ae8-ad0b-c849ad95917b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Getting quotas for user 1dbfb1a3e99c418098c2b02aea93b923 and project 41cca09950c34cc7baded0eb0a42bb07. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:36:39.083215 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e7f287f9-e4e4-4ae8-ad0b-c849ad95917b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.846485 Sep 27 16:36:39.084058 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 9/23] 10.222.0.64 () {62 vars in 1200 bytes} [Tue Sep 27 16:36:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 849 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 27 16:36:39.878488 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-eb97bced-432a-4f95-bc5d-9dae859ff48a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:39.879909 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-eb97bced-432a-4f95-bc5d-9dae859ff48a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:39.939046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eb97bced-432a-4f95-bc5d-9dae859ff48a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:39.942647 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eb97bced-432a-4f95-bc5d-9dae859ff48a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:39.943180 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eb97bced-432a-4f95-bc5d-9dae859ff48a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:39.943936 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eb97bced-432a-4f95-bc5d-9dae859ff48a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:39.947562 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eb97bced-432a-4f95-bc5d-9dae859ff48a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:39.954958 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eb97bced-432a-4f95-bc5d-9dae859ff48a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:40.307832 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-eb97bced-432a-4f95-bc5d-9dae859ff48a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:40.327254 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-eb97bced-432a-4f95-bc5d-9dae859ff48a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1267 microversion: 2.1 time: 0.458108 Sep 27 16:36:40.370887 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 15/24] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:39 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1267 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:36:40.704015 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ec593b7b-2897-4445-9542-0741da070b82 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Action: 'create', calling method: .version_select at 0x7fa407069940>, body: {"keypair": {"name": "tempest-keypair-2051996152", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOl6oXBlOi26l5qYdlraSy0dnGqLsyL9iKnq0HFXwb+e+IQOOh4NNiPdYPmxpK9vJ97D3kkoTrvD7Xr+xHdHEMJNGWf7MIYOXvO6njixeNBb7w//mWFbWod22tIFZgcqZw=="}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:36:40.767986 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-ec593b7b-2897-4445-9542-0741da070b82 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Getting quotas for project 73fad530905b485cb7141793f6130a9e. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:36:40.780161 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-ec593b7b-2897-4445-9542-0741da070b82 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Getting quotas for user e8d3af2b82b641aea11ebf79677a3af1 and project 73fad530905b485cb7141793f6130a9e. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:36:41.006280 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ec593b7b-2897-4445-9542-0741da070b82 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.964258 Sep 27 16:36:41.007288 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 10/25] 10.222.0.64 () {60 vars in 1159 bytes} [Tue Sep 27 16:36:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:36:41.361257 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-26784959-057d-4579-a18c-c6bf6ea58c8f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:41.361956 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-26784959-057d-4579-a18c-c6bf6ea58c8f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:41.373792 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26784959-057d-4579-a18c-c6bf6ea58c8f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:41.373917 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26784959-057d-4579-a18c-c6bf6ea58c8f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:41.374554 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26784959-057d-4579-a18c-c6bf6ea58c8f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:41.378031 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26784959-057d-4579-a18c-c6bf6ea58c8f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:41.379611 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26784959-057d-4579-a18c-c6bf6ea58c8f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:41.380225 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26784959-057d-4579-a18c-c6bf6ea58c8f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:41.532653 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-26784959-057d-4579-a18c-c6bf6ea58c8f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:41.552931 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-26784959-057d-4579-a18c-c6bf6ea58c8f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1273 microversion: 2.1 time: 0.198740 Sep 27 16:36:41.562246 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 16/26] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:41 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1273 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:36:42.589217 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3286fca8-c55d-4ca8-adab-4b3606b42e1a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:42.597052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3286fca8-c55d-4ca8-adab-4b3606b42e1a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:42.633707 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3286fca8-c55d-4ca8-adab-4b3606b42e1a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:42.639846 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3286fca8-c55d-4ca8-adab-4b3606b42e1a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:42.640724 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3286fca8-c55d-4ca8-adab-4b3606b42e1a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:42.645961 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3286fca8-c55d-4ca8-adab-4b3606b42e1a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:42.646609 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3286fca8-c55d-4ca8-adab-4b3606b42e1a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:42.647903 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3286fca8-c55d-4ca8-adab-4b3606b42e1a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:43.244597 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3286fca8-c55d-4ca8-adab-4b3606b42e1a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:43.282557 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3286fca8-c55d-4ca8-adab-4b3606b42e1a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1273 microversion: 2.1 time: 0.697697 Sep 27 16:36:43.283083 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 11/27] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:42 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1273 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:36:44.312861 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-267ed736-6bfb-4f07-b99b-57144ee971a8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:44.313459 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-267ed736-6bfb-4f07-b99b-57144ee971a8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:44.328305 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-267ed736-6bfb-4f07-b99b-57144ee971a8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:44.331404 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-267ed736-6bfb-4f07-b99b-57144ee971a8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:44.332060 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-267ed736-6bfb-4f07-b99b-57144ee971a8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:44.334555 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-267ed736-6bfb-4f07-b99b-57144ee971a8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:44.339679 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-267ed736-6bfb-4f07-b99b-57144ee971a8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:44.340157 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-267ed736-6bfb-4f07-b99b-57144ee971a8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:44.863146 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-324210ae-f84b-4cb1-ad17-e76ea80b0f08 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-584482737", "imageRef": "6908a343-46fa-4801-bfb5-7ad92ac26956", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34ae499e-6ac1-41bb-a843-2b013f2ce3f9"}], "security_groups": [{"name": "tempest-securitygroup--844072381"}], "key_name": "tempest-keypair-2024487446", "user_data": "}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:36:44.897850 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:45.639167 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-324210ae-f84b-4cb1-ad17-e76ea80b0f08 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] validate_networks() for [('34ae499e-6ac1-41bb-a843-2b013f2ce3f9', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 16:36:45.673580 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-267ed736-6bfb-4f07-b99b-57144ee971a8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:45.687401 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-267ed736-6bfb-4f07-b99b-57144ee971a8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1315 microversion: 2.1 time: 1.377990 Sep 27 16:36:45.699084 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 17/28] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:44 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1315 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:36:46.724078 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-324210ae-f84b-4cb1-ad17-e76ea80b0f08 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 16:36:46.728219 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-324210ae-f84b-4cb1-ad17-e76ea80b0f08 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 16:36:46.730709 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-324210ae-f84b-4cb1-ad17-e76ea80b0f08 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 16:36:46.731640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-324210ae-f84b-4cb1-ad17-e76ea80b0f08 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 16:36:46.744617 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-468555d6-fb6e-46e0-9085-1ec4d07bb9ff tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:46.744617 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-468555d6-fb6e-46e0-9085-1ec4d07bb9ff tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:46.745153 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-324210ae-f84b-4cb1-ad17-e76ea80b0f08 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 16:36:46.769748 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-468555d6-fb6e-46e0-9085-1ec4d07bb9ff tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:46.770615 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-468555d6-fb6e-46e0-9085-1ec4d07bb9ff tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:46.771287 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-468555d6-fb6e-46e0-9085-1ec4d07bb9ff tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:46.773058 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-468555d6-fb6e-46e0-9085-1ec4d07bb9ff tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:46.774880 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-468555d6-fb6e-46e0-9085-1ec4d07bb9ff tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:46.779969 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-468555d6-fb6e-46e0-9085-1ec4d07bb9ff tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:46.797030 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-324210ae-f84b-4cb1-ad17-e76ea80b0f08 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:46.799611 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-324210ae-f84b-4cb1-ad17-e76ea80b0f08 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:46.802588 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-324210ae-f84b-4cb1-ad17-e76ea80b0f08 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:46.815488 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-324210ae-f84b-4cb1-ad17-e76ea80b0f08 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:46.817809 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-324210ae-f84b-4cb1-ad17-e76ea80b0f08 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:46.834411 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-324210ae-f84b-4cb1-ad17-e76ea80b0f08 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:46.944431 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-324210ae-f84b-4cb1-ad17-e76ea80b0f08 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Getting quotas for project 41cca09950c34cc7baded0eb0a42bb07. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:36:46.969663 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-324210ae-f84b-4cb1-ad17-e76ea80b0f08 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Getting quotas for user 1dbfb1a3e99c418098c2b02aea93b923 and project 41cca09950c34cc7baded0eb0a42bb07. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:36:46.999178 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-324210ae-f84b-4cb1-ad17-e76ea80b0f08 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 16:36:47.002412 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-324210ae-f84b-4cb1-ad17-e76ea80b0f08 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6908a343-46fa-4801-bfb5-7ad92ac26956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 16:36:47.210487 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-324210ae-f84b-4cb1-ad17-e76ea80b0f08 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.353425 Sep 27 16:36:47.224977 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 12/29] 10.222.0.64 () {62 vars in 1188 bytes} [Tue Sep 27 16:36:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 2370 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 27 16:36:47.238764 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a1dc195b-1630-4335-abd9-a06ebaa3d0ba tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:47.239627 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a1dc195b-1630-4335-abd9-a06ebaa3d0ba tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:47.350870 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-468555d6-fb6e-46e0-9085-1ec4d07bb9ff tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:47.365175 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-468555d6-fb6e-46e0-9085-1ec4d07bb9ff tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1315 microversion: 2.1 time: 0.652857 Sep 27 16:36:47.368368 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 18/30] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:46 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1315 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:36:47.462910 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a1dc195b-1630-4335-abd9-a06ebaa3d0ba tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:47.488904 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a1dc195b-1630-4335-abd9-a06ebaa3d0ba tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:47.491946 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a1dc195b-1630-4335-abd9-a06ebaa3d0ba tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:47.495112 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a1dc195b-1630-4335-abd9-a06ebaa3d0ba tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1281 microversion: 2.20 time: 0.268339 Sep 27 16:36:47.522719 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 13/31] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:36:47 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1281 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:36:48.392676 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-839f8de3-f5cf-4268-baa3-7d6c6f360f69 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:48.393263 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-839f8de3-f5cf-4268-baa3-7d6c6f360f69 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:48.405634 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=6 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:48.408425 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-839f8de3-f5cf-4268-baa3-7d6c6f360f69 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:48.412224 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-839f8de3-f5cf-4268-baa3-7d6c6f360f69 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:48.412900 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-839f8de3-f5cf-4268-baa3-7d6c6f360f69 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:48.417288 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-839f8de3-f5cf-4268-baa3-7d6c6f360f69 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:48.417288 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-839f8de3-f5cf-4268-baa3-7d6c6f360f69 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:48.417288 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-839f8de3-f5cf-4268-baa3-7d6c6f360f69 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:48.549335 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-87537990-e43e-41d4-b16b-3e7b808987cc tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:48.549961 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-87537990-e43e-41d4-b16b-3e7b808987cc tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:48.757777 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-87537990-e43e-41d4-b16b-3e7b808987cc tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:48.773223 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-87537990-e43e-41d4-b16b-3e7b808987cc tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:48.776920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-87537990-e43e-41d4-b16b-3e7b808987cc tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:48.791819 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-87537990-e43e-41d4-b16b-3e7b808987cc tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1281 microversion: 2.20 time: 0.244119 Sep 27 16:36:48.794037 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 14/32] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:36:48 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1281 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:36:49.189694 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-839f8de3-f5cf-4268-baa3-7d6c6f360f69 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:49.208211 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-839f8de3-f5cf-4268-baa3-7d6c6f360f69 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1315 microversion: 2.1 time: 0.819814 Sep 27 16:36:49.208802 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 19/33] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:48 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1315 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:36:49.594718 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b5182356-9253-42c1-a1a8-622d793b439f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-830779965", "imageRef": "6908a343-46fa-4801-bfb5-7ad92ac26956", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16983143-f1f9-476b-8846-75cee163a487"}], "security_groups": [{"name": "tempest-securitygroup--737917341"}], "key_name": "tempest-keypair-2051996152", "user_data": "}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:36:49.823922 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6e327323-52c0-4eb9-a9ce-5997ea17515b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:49.826027 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6e327323-52c0-4eb9-a9ce-5997ea17515b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:49.836492 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e327323-52c0-4eb9-a9ce-5997ea17515b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:49.837205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e327323-52c0-4eb9-a9ce-5997ea17515b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:49.843257 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e327323-52c0-4eb9-a9ce-5997ea17515b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:49.844100 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e327323-52c0-4eb9-a9ce-5997ea17515b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:49.844817 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e327323-52c0-4eb9-a9ce-5997ea17515b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:49.846403 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e327323-52c0-4eb9-a9ce-5997ea17515b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:49.958018 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-b5182356-9253-42c1-a1a8-622d793b439f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] validate_networks() for [('16983143-f1f9-476b-8846-75cee163a487', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 16:36:50.102947 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6e327323-52c0-4eb9-a9ce-5997ea17515b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:50.123225 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6e327323-52c0-4eb9-a9ce-5997ea17515b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:50.130742 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6e327323-52c0-4eb9-a9ce-5997ea17515b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:50.137118 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6e327323-52c0-4eb9-a9ce-5997ea17515b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1285 microversion: 2.20 time: 0.318061 Sep 27 16:36:50.138622 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 20/34] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:36:49 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1285 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:36:50.235753 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-90a451e1-13c7-480c-a410-afd5b1c19d08 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:50.236621 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-90a451e1-13c7-480c-a410-afd5b1c19d08 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:50.265155 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90a451e1-13c7-480c-a410-afd5b1c19d08 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:50.265155 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90a451e1-13c7-480c-a410-afd5b1c19d08 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:50.265155 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90a451e1-13c7-480c-a410-afd5b1c19d08 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:50.265155 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90a451e1-13c7-480c-a410-afd5b1c19d08 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:50.265750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90a451e1-13c7-480c-a410-afd5b1c19d08 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:50.265750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90a451e1-13c7-480c-a410-afd5b1c19d08 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:50.702281 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-90a451e1-13c7-480c-a410-afd5b1c19d08 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:50.725993 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-90a451e1-13c7-480c-a410-afd5b1c19d08 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1315 microversion: 2.1 time: 0.488350 Sep 27 16:36:50.727091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 21/35] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:50 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:36:51.167347 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-eeab013a-1582-42a6-9b1a-f4ac27ed351f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:51.167983 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-eeab013a-1582-42a6-9b1a-f4ac27ed351f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:51.187583 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eeab013a-1582-42a6-9b1a-f4ac27ed351f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:51.194413 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eeab013a-1582-42a6-9b1a-f4ac27ed351f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:51.195020 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eeab013a-1582-42a6-9b1a-f4ac27ed351f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:51.197130 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eeab013a-1582-42a6-9b1a-f4ac27ed351f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:51.197612 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eeab013a-1582-42a6-9b1a-f4ac27ed351f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:51.198659 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eeab013a-1582-42a6-9b1a-f4ac27ed351f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:51.699081 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-eeab013a-1582-42a6-9b1a-f4ac27ed351f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:51.709469 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-eeab013a-1582-42a6-9b1a-f4ac27ed351f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:51.730601 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-eeab013a-1582-42a6-9b1a-f4ac27ed351f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:51.734615 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-eeab013a-1582-42a6-9b1a-f4ac27ed351f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1333 microversion: 2.20 time: 0.570633 Sep 27 16:36:51.735233 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 22/36] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:36:51 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1333 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:36:51.739706 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-b5182356-9253-42c1-a1a8-622d793b439f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 16:36:51.740200 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-b5182356-9253-42c1-a1a8-622d793b439f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 16:36:51.740607 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-b5182356-9253-42c1-a1a8-622d793b439f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 16:36:51.741023 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-b5182356-9253-42c1-a1a8-622d793b439f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 16:36:51.741439 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-b5182356-9253-42c1-a1a8-622d793b439f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 16:36:51.751462 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5182356-9253-42c1-a1a8-622d793b439f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:51.751887 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5182356-9253-42c1-a1a8-622d793b439f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:51.752323 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5182356-9253-42c1-a1a8-622d793b439f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:51.753225 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5182356-9253-42c1-a1a8-622d793b439f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:51.753932 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5182356-9253-42c1-a1a8-622d793b439f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:51.754511 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5182356-9253-42c1-a1a8-622d793b439f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:51.759431 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e4e32eba-62f1-4966-afcb-cca27b61bdd3 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:51.760612 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e4e32eba-62f1-4966-afcb-cca27b61bdd3 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:51.774394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4e32eba-62f1-4966-afcb-cca27b61bdd3 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:51.775061 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4e32eba-62f1-4966-afcb-cca27b61bdd3 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:51.775200 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-b5182356-9253-42c1-a1a8-622d793b439f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Getting quotas for project 73fad530905b485cb7141793f6130a9e. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:36:51.776842 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4e32eba-62f1-4966-afcb-cca27b61bdd3 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:51.782032 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4e32eba-62f1-4966-afcb-cca27b61bdd3 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:51.783343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4e32eba-62f1-4966-afcb-cca27b61bdd3 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:51.783343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4e32eba-62f1-4966-afcb-cca27b61bdd3 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:51.795675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-b5182356-9253-42c1-a1a8-622d793b439f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Getting quotas for user e8d3af2b82b641aea11ebf79677a3af1 and project 73fad530905b485cb7141793f6130a9e. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:36:51.825463 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b5182356-9253-42c1-a1a8-622d793b439f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 16:36:51.828096 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b5182356-9253-42c1-a1a8-622d793b439f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6908a343-46fa-4801-bfb5-7ad92ac26956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 16:36:52.028914 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b5182356-9253-42c1-a1a8-622d793b439f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.438815 Sep 27 16:36:52.035143 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 15/37] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Sep 27 16:36:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 2446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 16:36:52.051871 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e4e32eba-62f1-4966-afcb-cca27b61bdd3 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:52.062303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e4e32eba-62f1-4966-afcb-cca27b61bdd3 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1315 microversion: 2.1 time: 0.309686 Sep 27 16:36:52.064388 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 23/38] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:51 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:36:52.085955 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7f442e96-d233-4e9b-9217-bda2052bca47 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:52.089318 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7f442e96-d233-4e9b-9217-bda2052bca47 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:52.191098 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7f442e96-d233-4e9b-9217-bda2052bca47 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:52.200990 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7f442e96-d233-4e9b-9217-bda2052bca47 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1241 microversion: 2.1 time: 0.135185 Sep 27 16:36:52.201633 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 24/39] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:52 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1241 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:36:52.405832 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-94fc3933-ee3f-4956-a938-df65efc4b5b7 req-db970fcf-32a6-41a1-a40d-8b0cca7ed8bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b665e8b-d6f6-4474-9066-70f12819fad1", "tag": "598be294-4d75-4e83-9ef3-4c13b0a611d9"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:36:52.478075 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-94fc3933-ee3f-4956-a938-df65efc4b5b7 req-db970fcf-32a6-41a1-a40d-8b0cca7ed8bb service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:52.486584 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-94fc3933-ee3f-4956-a938-df65efc4b5b7 req-db970fcf-32a6-41a1-a40d-8b0cca7ed8bb service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:52.488657 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-94fc3933-ee3f-4956-a938-df65efc4b5b7 req-db970fcf-32a6-41a1-a40d-8b0cca7ed8bb service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:52.530493 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-94fc3933-ee3f-4956-a938-df65efc4b5b7 req-db970fcf-32a6-41a1-a40d-8b0cca7ed8bb service nova] Creating event network-changed:598be294-4d75-4e83-9ef3-4c13b0a611d9 for instance 7b665e8b-d6f6-4474-9066-70f12819fad1 on hv-cinder-85506 Sep 27 16:36:52.531069 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-94fc3933-ee3f-4956-a938-df65efc4b5b7 req-db970fcf-32a6-41a1-a40d-8b0cca7ed8bb service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127618) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 27 16:36:52.531533 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-94fc3933-ee3f-4956-a938-df65efc4b5b7 req-db970fcf-32a6-41a1-a40d-8b0cca7ed8bb service nova] Acquired lock "compute-rpcapi-router" {{(pid=127618) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 27 16:36:52.536314 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32ce9ea5-450c-48bf-b45b-39b2f492a73a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:52.542673 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32ce9ea5-450c-48bf-b45b-39b2f492a73a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:52.546344 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32ce9ea5-450c-48bf-b45b-39b2f492a73a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:52.546344 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32ce9ea5-450c-48bf-b45b-39b2f492a73a None None] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:52.546344 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32ce9ea5-450c-48bf-b45b-39b2f492a73a None None] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:52.546344 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32ce9ea5-450c-48bf-b45b-39b2f492a73a None None] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:52.560669 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.compute.rpcapi [None req-32ce9ea5-450c-48bf-b45b-39b2f492a73a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 27 16:36:52.561830 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32ce9ea5-450c-48bf-b45b-39b2f492a73a None None] Releasing lock "compute-rpcapi-router" {{(pid=127618) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 27 16:36:52.582886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-32ce9ea5-450c-48bf-b45b-39b2f492a73a None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.545849 Sep 27 16:36:52.583705 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 16/40] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:36:52.762726 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-df28c9f9-dc72-4ab6-812c-de787751d1ae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:52.763717 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-df28c9f9-dc72-4ab6-812c-de787751d1ae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:52.789374 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df28c9f9-dc72-4ab6-812c-de787751d1ae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:52.793254 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df28c9f9-dc72-4ab6-812c-de787751d1ae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:52.794189 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df28c9f9-dc72-4ab6-812c-de787751d1ae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:52.797793 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df28c9f9-dc72-4ab6-812c-de787751d1ae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:52.799903 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df28c9f9-dc72-4ab6-812c-de787751d1ae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:52.802003 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df28c9f9-dc72-4ab6-812c-de787751d1ae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:53.054214 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-df28c9f9-dc72-4ab6-812c-de787751d1ae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:53.066257 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-df28c9f9-dc72-4ab6-812c-de787751d1ae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:53.070153 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-df28c9f9-dc72-4ab6-812c-de787751d1ae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:53.080180 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-df28c9f9-dc72-4ab6-812c-de787751d1ae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1341 microversion: 2.20 time: 0.320431 Sep 27 16:36:53.080180 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 25/41] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:36:52 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1341 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:36:53.102164 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-abad4ad0-d26f-4ba5-9772-dde9a988c5ea tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:53.106221 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-abad4ad0-d26f-4ba5-9772-dde9a988c5ea tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:53.116541 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abad4ad0-d26f-4ba5-9772-dde9a988c5ea tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:53.117312 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abad4ad0-d26f-4ba5-9772-dde9a988c5ea tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:53.118862 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abad4ad0-d26f-4ba5-9772-dde9a988c5ea tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:53.119896 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abad4ad0-d26f-4ba5-9772-dde9a988c5ea tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:53.121020 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abad4ad0-d26f-4ba5-9772-dde9a988c5ea tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:53.121752 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abad4ad0-d26f-4ba5-9772-dde9a988c5ea tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:53.228630 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d26b855b-15af-4b04-9cb2-dcf5c1dda42e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:53.229861 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d26b855b-15af-4b04-9cb2-dcf5c1dda42e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:53.378525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d26b855b-15af-4b04-9cb2-dcf5c1dda42e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:53.387539 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d26b855b-15af-4b04-9cb2-dcf5c1dda42e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1241 microversion: 2.1 time: 0.162631 Sep 27 16:36:53.406385 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 26/42] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:53 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1241 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:36:53.537733 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-abad4ad0-d26f-4ba5-9772-dde9a988c5ea tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:53.553077 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-abad4ad0-d26f-4ba5-9772-dde9a988c5ea tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1315 microversion: 2.1 time: 0.467417 Sep 27 16:36:53.554624 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 17/43] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:53 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:36:54.105927 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-66a02c5b-c628-4dce-bfab-eb6091973973 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:54.107652 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-66a02c5b-c628-4dce-bfab-eb6091973973 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:54.116939 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66a02c5b-c628-4dce-bfab-eb6091973973 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:54.120436 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66a02c5b-c628-4dce-bfab-eb6091973973 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:54.122884 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66a02c5b-c628-4dce-bfab-eb6091973973 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:54.122884 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66a02c5b-c628-4dce-bfab-eb6091973973 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:54.122884 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66a02c5b-c628-4dce-bfab-eb6091973973 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:54.122884 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66a02c5b-c628-4dce-bfab-eb6091973973 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:54.318538 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-66a02c5b-c628-4dce-bfab-eb6091973973 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:54.333529 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-66a02c5b-c628-4dce-bfab-eb6091973973 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:54.339932 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-66a02c5b-c628-4dce-bfab-eb6091973973 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:54.342105 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-66a02c5b-c628-4dce-bfab-eb6091973973 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1339 microversion: 2.20 time: 0.241524 Sep 27 16:36:54.347258 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 27/44] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:36:54 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1339 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:36:54.422106 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f745ff58-baa0-45f9-a37f-75989febdca3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:54.422106 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f745ff58-baa0-45f9-a37f-75989febdca3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:54.427617 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f745ff58-baa0-45f9-a37f-75989febdca3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:54.428201 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f745ff58-baa0-45f9-a37f-75989febdca3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:54.429028 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f745ff58-baa0-45f9-a37f-75989febdca3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:54.431424 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f745ff58-baa0-45f9-a37f-75989febdca3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:54.433161 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f745ff58-baa0-45f9-a37f-75989febdca3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:54.434456 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f745ff58-baa0-45f9-a37f-75989febdca3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:54.576458 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-703c173c-a21e-412a-bbb8-875fd62b327a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:54.577074 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-703c173c-a21e-412a-bbb8-875fd62b327a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:54.587985 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-703c173c-a21e-412a-bbb8-875fd62b327a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:54.588582 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-703c173c-a21e-412a-bbb8-875fd62b327a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:54.591762 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-703c173c-a21e-412a-bbb8-875fd62b327a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:54.591762 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-703c173c-a21e-412a-bbb8-875fd62b327a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:54.591762 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-703c173c-a21e-412a-bbb8-875fd62b327a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:54.591762 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-703c173c-a21e-412a-bbb8-875fd62b327a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:54.625683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f745ff58-baa0-45f9-a37f-75989febdca3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:54.649931 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f745ff58-baa0-45f9-a37f-75989febdca3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1245 microversion: 2.1 time: 0.233225 Sep 27 16:36:54.653555 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 18/45] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:54 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1245 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:36:55.056733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-703c173c-a21e-412a-bbb8-875fd62b327a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:55.056733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-703c173c-a21e-412a-bbb8-875fd62b327a tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1315 microversion: 2.1 time: 0.481960 Sep 27 16:36:55.057901 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 28/46] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:54 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:36:55.389013 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b064f52c-12b4-44e7-8dfd-0f14c73e190a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:55.392595 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b064f52c-12b4-44e7-8dfd-0f14c73e190a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:55.402941 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b064f52c-12b4-44e7-8dfd-0f14c73e190a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:55.403899 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b064f52c-12b4-44e7-8dfd-0f14c73e190a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:55.405106 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b064f52c-12b4-44e7-8dfd-0f14c73e190a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:55.406333 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b064f52c-12b4-44e7-8dfd-0f14c73e190a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:55.406915 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b064f52c-12b4-44e7-8dfd-0f14c73e190a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:55.407403 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b064f52c-12b4-44e7-8dfd-0f14c73e190a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:55.680941 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3b8ad068-d746-4825-8082-54519c05c5ef tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:55.684775 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3b8ad068-d746-4825-8082-54519c05c5ef tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:55.700986 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b8ad068-d746-4825-8082-54519c05c5ef tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:55.701739 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b8ad068-d746-4825-8082-54519c05c5ef tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:55.702377 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b8ad068-d746-4825-8082-54519c05c5ef tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:55.704147 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b8ad068-d746-4825-8082-54519c05c5ef tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:55.719420 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b8ad068-d746-4825-8082-54519c05c5ef tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:55.720215 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b8ad068-d746-4825-8082-54519c05c5ef tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:55.915490 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3b8ad068-d746-4825-8082-54519c05c5ef tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:55.915490 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3b8ad068-d746-4825-8082-54519c05c5ef tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1293 microversion: 2.1 time: 0.228503 Sep 27 16:36:55.915490 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 29/47] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:55 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1293 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:36:55.954552 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b064f52c-12b4-44e7-8dfd-0f14c73e190a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:55.960055 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b064f52c-12b4-44e7-8dfd-0f14c73e190a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:55.963851 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b064f52c-12b4-44e7-8dfd-0f14c73e190a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:55.965438 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b064f52c-12b4-44e7-8dfd-0f14c73e190a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1406 microversion: 2.20 time: 0.594648 Sep 27 16:36:55.966499 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 19/48] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:36:55 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1406 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:36:56.081288 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b827124e-d77c-4a81-9c37-8054a8c3277b tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:56.082027 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b827124e-d77c-4a81-9c37-8054a8c3277b tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:56.098057 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b827124e-d77c-4a81-9c37-8054a8c3277b tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:56.098057 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b827124e-d77c-4a81-9c37-8054a8c3277b tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:56.098057 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b827124e-d77c-4a81-9c37-8054a8c3277b tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:56.098057 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b827124e-d77c-4a81-9c37-8054a8c3277b tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:56.098613 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b827124e-d77c-4a81-9c37-8054a8c3277b tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:56.098613 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b827124e-d77c-4a81-9c37-8054a8c3277b tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:56.249916 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b827124e-d77c-4a81-9c37-8054a8c3277b tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:56.257940 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b827124e-d77c-4a81-9c37-8054a8c3277b tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1315 microversion: 2.1 time: 0.182559 Sep 27 16:36:56.258830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 30/49] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:56 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:36:56.933322 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-50e41112-ed96-4b7f-b10e-46637a96839e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:56.933322 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-50e41112-ed96-4b7f-b10e-46637a96839e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:56.938996 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50e41112-ed96-4b7f-b10e-46637a96839e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:56.939484 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50e41112-ed96-4b7f-b10e-46637a96839e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:56.939952 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50e41112-ed96-4b7f-b10e-46637a96839e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:56.940736 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50e41112-ed96-4b7f-b10e-46637a96839e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:56.941368 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50e41112-ed96-4b7f-b10e-46637a96839e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:56.941881 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50e41112-ed96-4b7f-b10e-46637a96839e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:57.005813 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3088676d-5756-4a33-ad81-86b5cd098ffa tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:57.007675 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3088676d-5756-4a33-ad81-86b5cd098ffa tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:57.014091 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-50e41112-ed96-4b7f-b10e-46637a96839e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:57.020519 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3088676d-5756-4a33-ad81-86b5cd098ffa tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:57.021001 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3088676d-5756-4a33-ad81-86b5cd098ffa tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:57.021450 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3088676d-5756-4a33-ad81-86b5cd098ffa tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:57.022158 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3088676d-5756-4a33-ad81-86b5cd098ffa tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:57.022612 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3088676d-5756-4a33-ad81-86b5cd098ffa tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:57.023063 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3088676d-5756-4a33-ad81-86b5cd098ffa tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:57.031473 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-50e41112-ed96-4b7f-b10e-46637a96839e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1293 microversion: 2.1 time: 0.105476 Sep 27 16:36:57.033495 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 20/50] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:56 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1293 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:36:57.161309 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3088676d-5756-4a33-ad81-86b5cd098ffa tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:57.170383 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3088676d-5756-4a33-ad81-86b5cd098ffa tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:57.171852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3088676d-5756-4a33-ad81-86b5cd098ffa tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:57.172933 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3088676d-5756-4a33-ad81-86b5cd098ffa tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1406 microversion: 2.20 time: 0.171223 Sep 27 16:36:57.173480 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 31/51] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:36:57 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:36:57.280663 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-da1441b6-ee8e-41cc-9b3e-66f24adb9f18 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:57.281195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-da1441b6-ee8e-41cc-9b3e-66f24adb9f18 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:57.287427 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-da1441b6-ee8e-41cc-9b3e-66f24adb9f18 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:57.287946 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-da1441b6-ee8e-41cc-9b3e-66f24adb9f18 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:57.288371 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-da1441b6-ee8e-41cc-9b3e-66f24adb9f18 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:57.289052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-da1441b6-ee8e-41cc-9b3e-66f24adb9f18 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:57.289503 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-da1441b6-ee8e-41cc-9b3e-66f24adb9f18 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:57.289921 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-da1441b6-ee8e-41cc-9b3e-66f24adb9f18 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:57.430271 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-da1441b6-ee8e-41cc-9b3e-66f24adb9f18 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:57.438613 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-da1441b6-ee8e-41cc-9b3e-66f24adb9f18 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1315 microversion: 2.1 time: 0.162037 Sep 27 16:36:57.439227 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 21/52] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:57 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:36:58.058876 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-07e8c63c-746f-485c-9b93-39ee679df113 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:58.060080 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-07e8c63c-746f-485c-9b93-39ee679df113 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:58.067411 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07e8c63c-746f-485c-9b93-39ee679df113 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:58.073003 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07e8c63c-746f-485c-9b93-39ee679df113 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:58.073003 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07e8c63c-746f-485c-9b93-39ee679df113 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:58.073003 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07e8c63c-746f-485c-9b93-39ee679df113 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:58.073003 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07e8c63c-746f-485c-9b93-39ee679df113 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:58.073551 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07e8c63c-746f-485c-9b93-39ee679df113 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:58.106636 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:58.149830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-07e8c63c-746f-485c-9b93-39ee679df113 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:58.158295 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-07e8c63c-746f-485c-9b93-39ee679df113 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1301 microversion: 2.1 time: 0.104423 Sep 27 16:36:58.159173 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 32/53] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:58 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1301 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:36:58.204164 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-07ae20f5-2894-4a1a-be0b-c626ff87c71a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:58.205780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-07ae20f5-2894-4a1a-be0b-c626ff87c71a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:58.232718 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=11 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:58.234634 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07ae20f5-2894-4a1a-be0b-c626ff87c71a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:58.235407 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07ae20f5-2894-4a1a-be0b-c626ff87c71a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:58.236011 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07ae20f5-2894-4a1a-be0b-c626ff87c71a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:58.236727 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07ae20f5-2894-4a1a-be0b-c626ff87c71a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:58.237193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07ae20f5-2894-4a1a-be0b-c626ff87c71a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:58.237625 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07ae20f5-2894-4a1a-be0b-c626ff87c71a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:58.242158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=47 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:36:58.403501 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-07ae20f5-2894-4a1a-be0b-c626ff87c71a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:58.413337 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-07ae20f5-2894-4a1a-be0b-c626ff87c71a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:58.414814 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-07ae20f5-2894-4a1a-be0b-c626ff87c71a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:58.415943 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-07ae20f5-2894-4a1a-be0b-c626ff87c71a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1406 microversion: 2.20 time: 0.221184 Sep 27 16:36:58.432699 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 22/54] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:36:58 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:36:58.466414 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4414a55d-98f3-4fc4-a17b-664e5dbc1a5f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:58.466414 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4414a55d-98f3-4fc4-a17b-664e5dbc1a5f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:58.473517 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4414a55d-98f3-4fc4-a17b-664e5dbc1a5f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:58.474304 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4414a55d-98f3-4fc4-a17b-664e5dbc1a5f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:58.475052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4414a55d-98f3-4fc4-a17b-664e5dbc1a5f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:58.476045 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4414a55d-98f3-4fc4-a17b-664e5dbc1a5f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:58.476708 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4414a55d-98f3-4fc4-a17b-664e5dbc1a5f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:58.477464 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4414a55d-98f3-4fc4-a17b-664e5dbc1a5f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:58.612125 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-42244c6f-165f-460f-b730-244a8551d2bd req-f7908665-df35-4c13-853e-4fbcfa9a496a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f84acf37-9445-48cd-a921-12a7a3c301d9", "tag": "184e6faa-be62-4210-acc1-64aceea7f1f0"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:36:58.627997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-42244c6f-165f-460f-b730-244a8551d2bd req-f7908665-df35-4c13-853e-4fbcfa9a496a service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:58.637261 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-42244c6f-165f-460f-b730-244a8551d2bd req-f7908665-df35-4c13-853e-4fbcfa9a496a service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:58.637261 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-42244c6f-165f-460f-b730-244a8551d2bd req-f7908665-df35-4c13-853e-4fbcfa9a496a service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:58.637486 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4414a55d-98f3-4fc4-a17b-664e5dbc1a5f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:58.643091 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4414a55d-98f3-4fc4-a17b-664e5dbc1a5f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1315 microversion: 2.1 time: 0.185479 Sep 27 16:36:58.643663 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 23/55] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:58 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:36:58.655277 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-42244c6f-165f-460f-b730-244a8551d2bd req-f7908665-df35-4c13-853e-4fbcfa9a496a service nova] Creating event network-changed:184e6faa-be62-4210-acc1-64aceea7f1f0 for instance f84acf37-9445-48cd-a921-12a7a3c301d9 on hv-cinder-85506 Sep 27 16:36:58.656128 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-42244c6f-165f-460f-b730-244a8551d2bd req-f7908665-df35-4c13-853e-4fbcfa9a496a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127617) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 27 16:36:58.656686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-42244c6f-165f-460f-b730-244a8551d2bd req-f7908665-df35-4c13-853e-4fbcfa9a496a service nova] Acquired lock "compute-rpcapi-router" {{(pid=127617) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 27 16:36:58.657983 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad5d8da7-f975-4af3-a07e-93ceebae386e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:58.658440 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad5d8da7-f975-4af3-a07e-93ceebae386e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:58.659307 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad5d8da7-f975-4af3-a07e-93ceebae386e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:58.665838 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad5d8da7-f975-4af3-a07e-93ceebae386e None None] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:58.665838 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad5d8da7-f975-4af3-a07e-93ceebae386e None None] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:58.665838 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad5d8da7-f975-4af3-a07e-93ceebae386e None None] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:58.673374 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.compute.rpcapi [None req-ad5d8da7-f975-4af3-a07e-93ceebae386e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 27 16:36:58.674413 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad5d8da7-f975-4af3-a07e-93ceebae386e None None] Releasing lock "compute-rpcapi-router" {{(pid=127617) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 27 16:36:58.710317 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ad5d8da7-f975-4af3-a07e-93ceebae386e None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.357141 Sep 27 16:36:58.717053 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 33/56] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:36:59.206860 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3164d3f6-24a0-4e67-b787-56b7772fcef1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:59.208009 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3164d3f6-24a0-4e67-b787-56b7772fcef1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:59.215681 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3164d3f6-24a0-4e67-b787-56b7772fcef1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:59.216712 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3164d3f6-24a0-4e67-b787-56b7772fcef1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:59.216712 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3164d3f6-24a0-4e67-b787-56b7772fcef1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:59.217370 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3164d3f6-24a0-4e67-b787-56b7772fcef1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:59.218487 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3164d3f6-24a0-4e67-b787-56b7772fcef1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:59.219081 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3164d3f6-24a0-4e67-b787-56b7772fcef1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:59.313815 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3164d3f6-24a0-4e67-b787-56b7772fcef1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:59.326116 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3164d3f6-24a0-4e67-b787-56b7772fcef1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1301 microversion: 2.1 time: 0.129393 Sep 27 16:36:59.329024 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 24/57] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:59 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1301 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:36:59.449684 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-87d7c7d5-a348-4344-9519-b7aca3a1be72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:59.456347 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-87d7c7d5-a348-4344-9519-b7aca3a1be72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:59.484763 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87d7c7d5-a348-4344-9519-b7aca3a1be72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:59.486760 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87d7c7d5-a348-4344-9519-b7aca3a1be72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:59.488946 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87d7c7d5-a348-4344-9519-b7aca3a1be72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:59.490115 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87d7c7d5-a348-4344-9519-b7aca3a1be72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:59.492514 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87d7c7d5-a348-4344-9519-b7aca3a1be72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:59.493203 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87d7c7d5-a348-4344-9519-b7aca3a1be72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:59.665755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fe14f183-40ff-41f3-b7e1-f0a4592256d1 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:36:59.666455 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fe14f183-40ff-41f3-b7e1-f0a4592256d1 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:36:59.678079 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fe14f183-40ff-41f3-b7e1-f0a4592256d1 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:59.678641 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fe14f183-40ff-41f3-b7e1-f0a4592256d1 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:59.679107 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fe14f183-40ff-41f3-b7e1-f0a4592256d1 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:59.679808 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fe14f183-40ff-41f3-b7e1-f0a4592256d1 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:36:59.680256 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fe14f183-40ff-41f3-b7e1-f0a4592256d1 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:36:59.680715 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fe14f183-40ff-41f3-b7e1-f0a4592256d1 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:36:59.867832 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-87d7c7d5-a348-4344-9519-b7aca3a1be72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:59.887852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-87d7c7d5-a348-4344-9519-b7aca3a1be72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:59.889103 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-87d7c7d5-a348-4344-9519-b7aca3a1be72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:36:59.890229 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-87d7c7d5-a348-4344-9519-b7aca3a1be72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1406 microversion: 2.20 time: 0.451747 Sep 27 16:36:59.892008 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 34/58] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:36:59 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1406 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:37:00.051460 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fe14f183-40ff-41f3-b7e1-f0a4592256d1 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:00.065269 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fe14f183-40ff-41f3-b7e1-f0a4592256d1 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1315 microversion: 2.1 time: 0.402119 Sep 27 16:37:00.067476 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 25/59] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:36:59 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:00.353111 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-87fdf2d1-ef35-41d0-b83a-3da9a22fb336 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:00.354087 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-87fdf2d1-ef35-41d0-b83a-3da9a22fb336 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:00.360644 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87fdf2d1-ef35-41d0-b83a-3da9a22fb336 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:00.361252 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87fdf2d1-ef35-41d0-b83a-3da9a22fb336 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:00.361773 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87fdf2d1-ef35-41d0-b83a-3da9a22fb336 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:00.362635 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87fdf2d1-ef35-41d0-b83a-3da9a22fb336 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:00.363301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87fdf2d1-ef35-41d0-b83a-3da9a22fb336 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:00.363917 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87fdf2d1-ef35-41d0-b83a-3da9a22fb336 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:00.560927 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-87fdf2d1-ef35-41d0-b83a-3da9a22fb336 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:00.569896 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-87fdf2d1-ef35-41d0-b83a-3da9a22fb336 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1366 microversion: 2.1 time: 0.220475 Sep 27 16:37:00.584006 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 35/60] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:00 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:00.917189 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-39638031-c0e7-44d0-bd85-b5b6e45242cd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:00.918658 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-39638031-c0e7-44d0-bd85-b5b6e45242cd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:00.924985 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39638031-c0e7-44d0-bd85-b5b6e45242cd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:00.925358 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39638031-c0e7-44d0-bd85-b5b6e45242cd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:00.926112 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39638031-c0e7-44d0-bd85-b5b6e45242cd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:00.927171 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39638031-c0e7-44d0-bd85-b5b6e45242cd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:00.927957 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39638031-c0e7-44d0-bd85-b5b6e45242cd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:00.928697 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39638031-c0e7-44d0-bd85-b5b6e45242cd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:01.090415 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b4e0f102-229c-4c97-a011-27fc498f0d97 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:01.091049 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b4e0f102-229c-4c97-a011-27fc498f0d97 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:01.097045 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4e0f102-229c-4c97-a011-27fc498f0d97 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:01.097803 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4e0f102-229c-4c97-a011-27fc498f0d97 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:01.098394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4e0f102-229c-4c97-a011-27fc498f0d97 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:01.099265 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4e0f102-229c-4c97-a011-27fc498f0d97 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:01.099865 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4e0f102-229c-4c97-a011-27fc498f0d97 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:01.100487 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4e0f102-229c-4c97-a011-27fc498f0d97 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:01.180199 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-39638031-c0e7-44d0-bd85-b5b6e45242cd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:01.191438 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-39638031-c0e7-44d0-bd85-b5b6e45242cd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:01.194533 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-39638031-c0e7-44d0-bd85-b5b6e45242cd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:01.201532 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-39638031-c0e7-44d0-bd85-b5b6e45242cd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1406 microversion: 2.20 time: 0.284413 Sep 27 16:37:01.201532 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 26/61] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:37:00 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1406 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:37:01.333008 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b4e0f102-229c-4c97-a011-27fc498f0d97 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:01.364208 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b4e0f102-229c-4c97-a011-27fc498f0d97 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1315 microversion: 2.1 time: 0.277695 Sep 27 16:37:01.366347 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 36/62] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:01 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:01.598044 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c1f3fce2-528b-48d8-9531-f94b783d23c1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:01.600147 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c1f3fce2-528b-48d8-9531-f94b783d23c1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:01.620616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1f3fce2-528b-48d8-9531-f94b783d23c1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:01.621422 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1f3fce2-528b-48d8-9531-f94b783d23c1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:01.622196 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1f3fce2-528b-48d8-9531-f94b783d23c1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:01.623659 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1f3fce2-528b-48d8-9531-f94b783d23c1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:01.629783 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1f3fce2-528b-48d8-9531-f94b783d23c1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:01.631736 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1f3fce2-528b-48d8-9531-f94b783d23c1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:01.820578 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c1f3fce2-528b-48d8-9531-f94b783d23c1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:01.827086 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=30 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:01.834363 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c1f3fce2-528b-48d8-9531-f94b783d23c1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1366 microversion: 2.1 time: 0.242122 Sep 27 16:37:01.842152 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 27/63] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:01 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:02.019639 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-462e6a42-3581-4d90-a98c-7525485d65d1 req-81031edc-89a5-48a1-b1ba-dfa524b5238f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8010c1e5-fe22-4255-a8df-0f63551bb226", "tag": "28c38995-7f8b-4c47-85ed-9090cbdf348e"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:37:02.036349 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-462e6a42-3581-4d90-a98c-7525485d65d1 req-81031edc-89a5-48a1-b1ba-dfa524b5238f service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:02.037373 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-462e6a42-3581-4d90-a98c-7525485d65d1 req-81031edc-89a5-48a1-b1ba-dfa524b5238f service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:02.038013 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-462e6a42-3581-4d90-a98c-7525485d65d1 req-81031edc-89a5-48a1-b1ba-dfa524b5238f service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:02.062851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-462e6a42-3581-4d90-a98c-7525485d65d1 req-81031edc-89a5-48a1-b1ba-dfa524b5238f service nova] Creating event network-changed:28c38995-7f8b-4c47-85ed-9090cbdf348e for instance 8010c1e5-fe22-4255-a8df-0f63551bb226 on hv-cinder-85506 Sep 27 16:37:02.069331 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-462e6a42-3581-4d90-a98c-7525485d65d1 req-81031edc-89a5-48a1-b1ba-dfa524b5238f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054058 Sep 27 16:37:02.071351 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 37/64] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:37:02.227528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-db335d7f-b0ee-4506-b11f-f0d384da68ce tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:02.228991 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-db335d7f-b0ee-4506-b11f-f0d384da68ce tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:02.245920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db335d7f-b0ee-4506-b11f-f0d384da68ce tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:02.245920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db335d7f-b0ee-4506-b11f-f0d384da68ce tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:02.245920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db335d7f-b0ee-4506-b11f-f0d384da68ce tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:02.245920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db335d7f-b0ee-4506-b11f-f0d384da68ce tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:02.246531 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db335d7f-b0ee-4506-b11f-f0d384da68ce tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:02.246531 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db335d7f-b0ee-4506-b11f-f0d384da68ce tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:02.395708 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-09d337b0-4eda-4934-b178-a171312b2588 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:02.396538 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-09d337b0-4eda-4934-b178-a171312b2588 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:02.409881 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09d337b0-4eda-4934-b178-a171312b2588 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:02.409881 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09d337b0-4eda-4934-b178-a171312b2588 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:02.409881 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09d337b0-4eda-4934-b178-a171312b2588 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:02.409881 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09d337b0-4eda-4934-b178-a171312b2588 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:02.410291 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09d337b0-4eda-4934-b178-a171312b2588 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:02.410291 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09d337b0-4eda-4934-b178-a171312b2588 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:02.558317 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=6 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:02.626340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-db335d7f-b0ee-4506-b11f-f0d384da68ce tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:02.636795 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-db335d7f-b0ee-4506-b11f-f0d384da68ce tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:02.643342 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-db335d7f-b0ee-4506-b11f-f0d384da68ce tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:02.647618 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-db335d7f-b0ee-4506-b11f-f0d384da68ce tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1406 microversion: 2.20 time: 0.426216 Sep 27 16:37:02.652825 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 28/65] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:37:02 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1406 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:37:02.733456 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-09d337b0-4eda-4934-b178-a171312b2588 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:02.745310 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-09d337b0-4eda-4934-b178-a171312b2588 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1315 microversion: 2.1 time: 0.353429 Sep 27 16:37:02.747193 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 38/66] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:02 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:37:02.865450 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bfbd84e6-30e6-4050-a9d7-fc3a345e26e0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:02.866054 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bfbd84e6-30e6-4050-a9d7-fc3a345e26e0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:02.872818 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bfbd84e6-30e6-4050-a9d7-fc3a345e26e0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:02.875356 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bfbd84e6-30e6-4050-a9d7-fc3a345e26e0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:02.875356 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bfbd84e6-30e6-4050-a9d7-fc3a345e26e0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:02.875356 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bfbd84e6-30e6-4050-a9d7-fc3a345e26e0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:02.875356 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bfbd84e6-30e6-4050-a9d7-fc3a345e26e0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:02.875705 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bfbd84e6-30e6-4050-a9d7-fc3a345e26e0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:03.024042 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bfbd84e6-30e6-4050-a9d7-fc3a345e26e0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:03.034729 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bfbd84e6-30e6-4050-a9d7-fc3a345e26e0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1366 microversion: 2.1 time: 0.173165 Sep 27 16:37:03.035921 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 29/67] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:02 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:03.676582 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fc91bb8b-308f-4e02-8a9a-f96d3130a3d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:03.679001 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fc91bb8b-308f-4e02-8a9a-f96d3130a3d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:03.698519 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=4 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:03.699428 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc91bb8b-308f-4e02-8a9a-f96d3130a3d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:03.700010 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc91bb8b-308f-4e02-8a9a-f96d3130a3d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:03.700873 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc91bb8b-308f-4e02-8a9a-f96d3130a3d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:03.701912 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc91bb8b-308f-4e02-8a9a-f96d3130a3d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:03.702558 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc91bb8b-308f-4e02-8a9a-f96d3130a3d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:03.703507 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc91bb8b-308f-4e02-8a9a-f96d3130a3d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:03.773597 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fd20776a-22e9-4f5a-ae50-3e6a40a610c8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:03.774931 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fd20776a-22e9-4f5a-ae50-3e6a40a610c8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:03.782565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd20776a-22e9-4f5a-ae50-3e6a40a610c8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:03.784392 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd20776a-22e9-4f5a-ae50-3e6a40a610c8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:03.785018 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd20776a-22e9-4f5a-ae50-3e6a40a610c8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:03.793850 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd20776a-22e9-4f5a-ae50-3e6a40a610c8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:03.793850 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd20776a-22e9-4f5a-ae50-3e6a40a610c8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:03.795532 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd20776a-22e9-4f5a-ae50-3e6a40a610c8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:04.359240 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fc91bb8b-308f-4e02-8a9a-f96d3130a3d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:04.375575 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fd20776a-22e9-4f5a-ae50-3e6a40a610c8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:04.379916 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fc91bb8b-308f-4e02-8a9a-f96d3130a3d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:04.385709 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fc91bb8b-308f-4e02-8a9a-f96d3130a3d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:04.388530 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fc91bb8b-308f-4e02-8a9a-f96d3130a3d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1406 microversion: 2.20 time: 0.719495 Sep 27 16:37:04.395243 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 39/68] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:37:03 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1406 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:37:04.396495 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fd20776a-22e9-4f5a-ae50-3e6a40a610c8 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1315 microversion: 2.1 time: 0.630258 Sep 27 16:37:04.409141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 30/69] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:03 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:04.415622 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1bba7b31-00c9-411e-a6b9-8f72dca7ef05 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:04.419412 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1bba7b31-00c9-411e-a6b9-8f72dca7ef05 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:04.421534 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=69 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:04.427774 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1bba7b31-00c9-411e-a6b9-8f72dca7ef05 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:04.428275 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1bba7b31-00c9-411e-a6b9-8f72dca7ef05 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:04.428714 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1bba7b31-00c9-411e-a6b9-8f72dca7ef05 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:04.429765 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1bba7b31-00c9-411e-a6b9-8f72dca7ef05 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:04.430228 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1bba7b31-00c9-411e-a6b9-8f72dca7ef05 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:04.430654 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1bba7b31-00c9-411e-a6b9-8f72dca7ef05 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:04.640817 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1bba7b31-00c9-411e-a6b9-8f72dca7ef05 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:04.660755 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1bba7b31-00c9-411e-a6b9-8f72dca7ef05 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1366 microversion: 2.1 time: 0.264271 Sep 27 16:37:04.671970 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 40/70] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:04 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:04.866363 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-3abc4a60-5818-425b-b23b-00143e6fb854 req-2b5d86b4-a563-4695-9451-fcd2950517d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b665e8b-d6f6-4474-9066-70f12819fad1", "name": "network-vif-plugged", "status": "completed", "tag": "598be294-4d75-4e83-9ef3-4c13b0a611d9"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:37:04.876719 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-3abc4a60-5818-425b-b23b-00143e6fb854 req-2b5d86b4-a563-4695-9451-fcd2950517d1 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:04.877217 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-3abc4a60-5818-425b-b23b-00143e6fb854 req-2b5d86b4-a563-4695-9451-fcd2950517d1 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:04.877611 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-3abc4a60-5818-425b-b23b-00143e6fb854 req-2b5d86b4-a563-4695-9451-fcd2950517d1 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:04.889529 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-3abc4a60-5818-425b-b23b-00143e6fb854 req-2b5d86b4-a563-4695-9451-fcd2950517d1 service nova] Creating event network-vif-plugged:598be294-4d75-4e83-9ef3-4c13b0a611d9 for instance 7b665e8b-d6f6-4474-9066-70f12819fad1 on hv-cinder-85506 Sep 27 16:37:04.895049 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-3abc4a60-5818-425b-b23b-00143e6fb854 req-2b5d86b4-a563-4695-9451-fcd2950517d1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.484394 Sep 27 16:37:04.895648 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 31/71] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:37:05.414593 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5c2fef20-29fa-4aa0-80d8-1337c46267cf tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:05.415315 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5c2fef20-29fa-4aa0-80d8-1337c46267cf tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:05.422967 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f4c22c6a-afec-450a-88d5-e9381ee2d168 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:05.424191 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f4c22c6a-afec-450a-88d5-e9381ee2d168 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:05.427818 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5c2fef20-29fa-4aa0-80d8-1337c46267cf tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:05.430606 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5c2fef20-29fa-4aa0-80d8-1337c46267cf tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:05.437413 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5c2fef20-29fa-4aa0-80d8-1337c46267cf tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:05.437833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f4c22c6a-afec-450a-88d5-e9381ee2d168 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:05.437914 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5c2fef20-29fa-4aa0-80d8-1337c46267cf tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:05.437914 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5c2fef20-29fa-4aa0-80d8-1337c46267cf tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:05.438039 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f4c22c6a-afec-450a-88d5-e9381ee2d168 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:05.438039 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f4c22c6a-afec-450a-88d5-e9381ee2d168 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:05.438170 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5c2fef20-29fa-4aa0-80d8-1337c46267cf tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:05.438240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f4c22c6a-afec-450a-88d5-e9381ee2d168 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:05.438550 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f4c22c6a-afec-450a-88d5-e9381ee2d168 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:05.439245 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f4c22c6a-afec-450a-88d5-e9381ee2d168 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:05.748218 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f4c22c6a-afec-450a-88d5-e9381ee2d168 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:05.756075 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f4c22c6a-afec-450a-88d5-e9381ee2d168 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1315 microversion: 2.1 time: 0.337312 Sep 27 16:37:05.760881 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 32/72] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:05 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:05.766952 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c025e79c-7468-4e29-908c-5ca0477f3a7c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:05.766952 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c025e79c-7468-4e29-908c-5ca0477f3a7c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:05.779047 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5c2fef20-29fa-4aa0-80d8-1337c46267cf tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:05.789778 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5c2fef20-29fa-4aa0-80d8-1337c46267cf tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:05.790638 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c025e79c-7468-4e29-908c-5ca0477f3a7c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:05.791390 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c025e79c-7468-4e29-908c-5ca0477f3a7c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:05.791910 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c025e79c-7468-4e29-908c-5ca0477f3a7c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:05.792280 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5c2fef20-29fa-4aa0-80d8-1337c46267cf tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:05.792726 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c025e79c-7468-4e29-908c-5ca0477f3a7c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:05.793213 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c025e79c-7468-4e29-908c-5ca0477f3a7c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:05.793593 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c025e79c-7468-4e29-908c-5ca0477f3a7c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:05.794378 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5c2fef20-29fa-4aa0-80d8-1337c46267cf tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1406 microversion: 2.20 time: 0.384794 Sep 27 16:37:05.801185 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 41/73] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:37:05 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1406 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:37:05.960153 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c025e79c-7468-4e29-908c-5ca0477f3a7c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:05.968576 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c025e79c-7468-4e29-908c-5ca0477f3a7c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1366 microversion: 2.1 time: 0.206725 Sep 27 16:37:05.969150 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 33/74] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:05 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:06.781989 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-380bbc62-42b9-495d-8a5d-646cea119ad4 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:06.782604 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-380bbc62-42b9-495d-8a5d-646cea119ad4 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:06.788789 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-380bbc62-42b9-495d-8a5d-646cea119ad4 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:06.789283 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-380bbc62-42b9-495d-8a5d-646cea119ad4 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:06.789762 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-380bbc62-42b9-495d-8a5d-646cea119ad4 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:06.790459 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-380bbc62-42b9-495d-8a5d-646cea119ad4 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:06.790948 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-380bbc62-42b9-495d-8a5d-646cea119ad4 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:06.792583 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-380bbc62-42b9-495d-8a5d-646cea119ad4 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:06.819768 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-85f40701-5791-45ec-bb3d-b28ba87b2fe0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:06.831118 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-85f40701-5791-45ec-bb3d-b28ba87b2fe0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:06.831118 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85f40701-5791-45ec-bb3d-b28ba87b2fe0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:06.831118 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85f40701-5791-45ec-bb3d-b28ba87b2fe0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:06.831118 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85f40701-5791-45ec-bb3d-b28ba87b2fe0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:06.831582 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85f40701-5791-45ec-bb3d-b28ba87b2fe0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:06.831582 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85f40701-5791-45ec-bb3d-b28ba87b2fe0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:06.831582 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85f40701-5791-45ec-bb3d-b28ba87b2fe0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:07.005110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-380bbc62-42b9-495d-8a5d-646cea119ad4 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:07.012426 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-85f40701-5791-45ec-bb3d-b28ba87b2fe0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:07.021763 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-380bbc62-42b9-495d-8a5d-646cea119ad4 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1315 microversion: 2.1 time: 0.239253 Sep 27 16:37:07.033602 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 42/75] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:06 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:07.039363 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-85f40701-5791-45ec-bb3d-b28ba87b2fe0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:07.039363 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-85f40701-5791-45ec-bb3d-b28ba87b2fe0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:07.040403 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-85f40701-5791-45ec-bb3d-b28ba87b2fe0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1406 microversion: 2.20 time: 0.224398 Sep 27 16:37:07.041698 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 34/76] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:37:06 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:37:07.043494 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-d03e777e-4865-4ed3-a5b7-3e29a460f410 req-da3c4a19-a5c1-4498-812b-8519ac9545fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84acf37-9445-48cd-a921-12a7a3c301d9", "name": "network-vif-plugged", "status": "completed", "tag": "184e6faa-be62-4210-acc1-64aceea7f1f0"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:37:07.064323 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-63c652c4-53de-4ba4-a6b5-c96ad91b59f2 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:07.064947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-63c652c4-53de-4ba4-a6b5-c96ad91b59f2 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:07.065063 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-d03e777e-4865-4ed3-a5b7-3e29a460f410 req-da3c4a19-a5c1-4498-812b-8519ac9545fd service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:07.066340 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-d03e777e-4865-4ed3-a5b7-3e29a460f410 req-da3c4a19-a5c1-4498-812b-8519ac9545fd service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:07.066340 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-d03e777e-4865-4ed3-a5b7-3e29a460f410 req-da3c4a19-a5c1-4498-812b-8519ac9545fd service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:07.080834 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63c652c4-53de-4ba4-a6b5-c96ad91b59f2 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:07.082109 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63c652c4-53de-4ba4-a6b5-c96ad91b59f2 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:07.083886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63c652c4-53de-4ba4-a6b5-c96ad91b59f2 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:07.084447 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-d03e777e-4865-4ed3-a5b7-3e29a460f410 req-da3c4a19-a5c1-4498-812b-8519ac9545fd service nova] Creating event network-vif-plugged:184e6faa-be62-4210-acc1-64aceea7f1f0 for instance f84acf37-9445-48cd-a921-12a7a3c301d9 on hv-cinder-85506 Sep 27 16:37:07.084839 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63c652c4-53de-4ba4-a6b5-c96ad91b59f2 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:07.085310 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63c652c4-53de-4ba4-a6b5-c96ad91b59f2 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:07.085742 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63c652c4-53de-4ba4-a6b5-c96ad91b59f2 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:07.091179 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-d03e777e-4865-4ed3-a5b7-3e29a460f410 req-da3c4a19-a5c1-4498-812b-8519ac9545fd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067171 Sep 27 16:37:07.092162 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 43/77] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:37:07.266070 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-63c652c4-53de-4ba4-a6b5-c96ad91b59f2 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:07.275189 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-63c652c4-53de-4ba4-a6b5-c96ad91b59f2 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1366 microversion: 2.1 time: 0.225749 Sep 27 16:37:07.276297 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 35/78] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:07 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:08.046529 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f5c2e8f4-2238-41af-ab81-94b744329e9e tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:08.047253 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f5c2e8f4-2238-41af-ab81-94b744329e9e tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:08.053266 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f5c2e8f4-2238-41af-ab81-94b744329e9e tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:08.053742 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f5c2e8f4-2238-41af-ab81-94b744329e9e tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:08.054172 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f5c2e8f4-2238-41af-ab81-94b744329e9e tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:08.054880 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f5c2e8f4-2238-41af-ab81-94b744329e9e tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:08.055332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f5c2e8f4-2238-41af-ab81-94b744329e9e tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:08.055747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f5c2e8f4-2238-41af-ab81-94b744329e9e tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:08.068675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6c14044f-015f-4551-8112-bda49125e876 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:08.069280 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6c14044f-015f-4551-8112-bda49125e876 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:08.076096 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c14044f-015f-4551-8112-bda49125e876 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:08.076576 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c14044f-015f-4551-8112-bda49125e876 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:08.077009 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c14044f-015f-4551-8112-bda49125e876 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:08.077790 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c14044f-015f-4551-8112-bda49125e876 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:08.078140 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c14044f-015f-4551-8112-bda49125e876 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:08.078565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c14044f-015f-4551-8112-bda49125e876 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:08.268724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f5c2e8f4-2238-41af-ab81-94b744329e9e tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:08.279276 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f5c2e8f4-2238-41af-ab81-94b744329e9e tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1502 microversion: 2.1 time: 0.236681 Sep 27 16:37:08.280741 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 44/79] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:08 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1502 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:08.285924 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6c14044f-015f-4551-8112-bda49125e876 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:08.295445 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6c14044f-015f-4551-8112-bda49125e876 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:08.297124 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6c14044f-015f-4551-8112-bda49125e876 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:08.298398 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6c14044f-015f-4551-8112-bda49125e876 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1406 microversion: 2.20 time: 0.233602 Sep 27 16:37:08.299286 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d90080a3-181b-46a5-bdd6-1bc3135145b0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:08.300277 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d90080a3-181b-46a5-bdd6-1bc3135145b0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:08.307252 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 36/80] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:37:08 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:37:08.308934 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d90080a3-181b-46a5-bdd6-1bc3135145b0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:08.309599 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d90080a3-181b-46a5-bdd6-1bc3135145b0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:08.310047 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d90080a3-181b-46a5-bdd6-1bc3135145b0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:08.310756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d90080a3-181b-46a5-bdd6-1bc3135145b0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:08.311233 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d90080a3-181b-46a5-bdd6-1bc3135145b0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:08.311666 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d90080a3-181b-46a5-bdd6-1bc3135145b0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:08.460030 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d90080a3-181b-46a5-bdd6-1bc3135145b0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:08.467870 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d90080a3-181b-46a5-bdd6-1bc3135145b0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1366 microversion: 2.1 time: 0.172552 Sep 27 16:37:08.468424 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 45/81] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:08 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:37:09.113339 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-41241d88-d1e2-4418-92cf-e98349920912 req-c2a180ac-c06b-4ff3-8e40-47790420f2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8010c1e5-fe22-4255-a8df-0f63551bb226", "name": "network-vif-plugged", "status": "completed", "tag": "28c38995-7f8b-4c47-85ed-9090cbdf348e"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:37:09.126360 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-41241d88-d1e2-4418-92cf-e98349920912 req-c2a180ac-c06b-4ff3-8e40-47790420f2e4 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:09.127155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-41241d88-d1e2-4418-92cf-e98349920912 req-c2a180ac-c06b-4ff3-8e40-47790420f2e4 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:09.127877 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-41241d88-d1e2-4418-92cf-e98349920912 req-c2a180ac-c06b-4ff3-8e40-47790420f2e4 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:09.143956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-41241d88-d1e2-4418-92cf-e98349920912 req-c2a180ac-c06b-4ff3-8e40-47790420f2e4 service nova] Creating event network-vif-plugged:28c38995-7f8b-4c47-85ed-9090cbdf348e for instance 8010c1e5-fe22-4255-a8df-0f63551bb226 on hv-cinder-85506 Sep 27 16:37:09.149309 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-41241d88-d1e2-4418-92cf-e98349920912 req-c2a180ac-c06b-4ff3-8e40-47790420f2e4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043245 Sep 27 16:37:09.150183 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 37/82] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:37:09.324588 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4b28f518-5ea5-4cdb-a34f-4458f50cd0a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:09.325808 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4b28f518-5ea5-4cdb-a34f-4458f50cd0a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:09.328659 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:09.335479 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b28f518-5ea5-4cdb-a34f-4458f50cd0a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:09.338120 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b28f518-5ea5-4cdb-a34f-4458f50cd0a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:09.340284 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b28f518-5ea5-4cdb-a34f-4458f50cd0a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:09.341257 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b28f518-5ea5-4cdb-a34f-4458f50cd0a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:09.341871 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b28f518-5ea5-4cdb-a34f-4458f50cd0a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:09.342428 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b28f518-5ea5-4cdb-a34f-4458f50cd0a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:09.492694 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5a6c733a-fa2d-4a86-9c41-6eaf59d76dd5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:09.493491 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5a6c733a-fa2d-4a86-9c41-6eaf59d76dd5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:09.504519 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5a6c733a-fa2d-4a86-9c41-6eaf59d76dd5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:09.505060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5a6c733a-fa2d-4a86-9c41-6eaf59d76dd5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:09.505548 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5a6c733a-fa2d-4a86-9c41-6eaf59d76dd5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:09.506332 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5a6c733a-fa2d-4a86-9c41-6eaf59d76dd5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:09.506868 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5a6c733a-fa2d-4a86-9c41-6eaf59d76dd5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:09.507376 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5a6c733a-fa2d-4a86-9c41-6eaf59d76dd5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:09.632926 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4b28f518-5ea5-4cdb-a34f-4458f50cd0a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:09.641063 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4b28f518-5ea5-4cdb-a34f-4458f50cd0a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:09.642506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4b28f518-5ea5-4cdb-a34f-4458f50cd0a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:09.643660 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4b28f518-5ea5-4cdb-a34f-4458f50cd0a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1406 microversion: 2.20 time: 0.324254 Sep 27 16:37:09.652173 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 46/83] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:37:09 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1406 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:37:09.837877 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5a6c733a-fa2d-4a86-9c41-6eaf59d76dd5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:09.847900 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5a6c733a-fa2d-4a86-9c41-6eaf59d76dd5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1366 microversion: 2.1 time: 0.359656 Sep 27 16:37:09.849485 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 38/84] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:09 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1366 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:37:10.595289 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9bbcf36a-9aa1-40ff-bec4-71b08655e7eb tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be05e1fb-8fd2-405a-aa4d-45becea2662f"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:37:10.597866 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9bbcf36a-9aa1-40ff-bec4-71b08655e7eb tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:10.604185 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9bbcf36a-9aa1-40ff-bec4-71b08655e7eb tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:10.605073 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9bbcf36a-9aa1-40ff-bec4-71b08655e7eb tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:10.623423 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9bbcf36a-9aa1-40ff-bec4-71b08655e7eb tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:10.624525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9bbcf36a-9aa1-40ff-bec4-71b08655e7eb tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:10.625027 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9bbcf36a-9aa1-40ff-bec4-71b08655e7eb tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:10.625470 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9bbcf36a-9aa1-40ff-bec4-71b08655e7eb tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:10.683066 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-44f31b94-76e5-449c-b864-482e94d370e5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:10.686306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-44f31b94-76e5-449c-b864-482e94d370e5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:10.696907 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-44f31b94-76e5-449c-b864-482e94d370e5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:10.699977 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-44f31b94-76e5-449c-b864-482e94d370e5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:10.701159 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-44f31b94-76e5-449c-b864-482e94d370e5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:10.703102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-44f31b94-76e5-449c-b864-482e94d370e5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:10.703786 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-44f31b94-76e5-449c-b864-482e94d370e5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:10.709045 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-44f31b94-76e5-449c-b864-482e94d370e5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:10.947234 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-44f31b94-76e5-449c-b864-482e94d370e5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:10.961098 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-44f31b94-76e5-449c-b864-482e94d370e5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:10.962554 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-44f31b94-76e5-449c-b864-482e94d370e5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:10.963968 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-44f31b94-76e5-449c-b864-482e94d370e5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1598 microversion: 2.20 time: 0.287302 Sep 27 16:37:10.968957 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 39/85] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:37:10 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1598 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:37:10.973740 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2f82054b-1f9f-4de7-b2e9-9ce84ff4cc76 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:10.974491 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2f82054b-1f9f-4de7-b2e9-9ce84ff4cc76 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:10.982467 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f82054b-1f9f-4de7-b2e9-9ce84ff4cc76 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:10.983811 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f82054b-1f9f-4de7-b2e9-9ce84ff4cc76 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:10.984373 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f82054b-1f9f-4de7-b2e9-9ce84ff4cc76 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:10.985364 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f82054b-1f9f-4de7-b2e9-9ce84ff4cc76 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:10.986293 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f82054b-1f9f-4de7-b2e9-9ce84ff4cc76 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:10.989497 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f82054b-1f9f-4de7-b2e9-9ce84ff4cc76 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:10.992695 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:11.141339 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2f82054b-1f9f-4de7-b2e9-9ce84ff4cc76 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:11.149195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2f82054b-1f9f-4de7-b2e9-9ce84ff4cc76 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1366 microversion: 2.1 time: 0.179133 Sep 27 16:37:11.149769 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 40/86] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:10 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:11.157793 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5c9ee44c-6edb-443c-a436-194cb50a6991 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:11.158556 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5c9ee44c-6edb-443c-a436-194cb50a6991 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:11.166370 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c9ee44c-6edb-443c-a436-194cb50a6991 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:11.167122 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c9ee44c-6edb-443c-a436-194cb50a6991 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:11.167736 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c9ee44c-6edb-443c-a436-194cb50a6991 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:11.169408 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c9ee44c-6edb-443c-a436-194cb50a6991 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:11.170740 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c9ee44c-6edb-443c-a436-194cb50a6991 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:11.171237 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c9ee44c-6edb-443c-a436-194cb50a6991 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:11.313478 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5c9ee44c-6edb-443c-a436-194cb50a6991 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.158572 Sep 27 16:37:11.313478 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 41/87] 10.222.0.64 () {60 vars in 1316 bytes} [Tue Sep 27 16:37:11 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 16:37:11.647945 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9bbcf36a-9aa1-40ff-bec4-71b08655e7eb tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "POST /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.057647 Sep 27 16:37:11.649050 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 47/88] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Sep 27 16:37:10 2022] POST /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1/os-volume_attachments => generated 194 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:37:12.178365 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0af6fd27-9a57-487c-b100-de45be185fe8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:12.179092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0af6fd27-9a57-487c-b100-de45be185fe8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:12.190292 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0af6fd27-9a57-487c-b100-de45be185fe8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:12.191127 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0af6fd27-9a57-487c-b100-de45be185fe8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:12.192938 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0af6fd27-9a57-487c-b100-de45be185fe8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:12.193656 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0af6fd27-9a57-487c-b100-de45be185fe8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:12.194112 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0af6fd27-9a57-487c-b100-de45be185fe8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:12.194535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0af6fd27-9a57-487c-b100-de45be185fe8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:12.544826 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0af6fd27-9a57-487c-b100-de45be185fe8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:12.564966 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0af6fd27-9a57-487c-b100-de45be185fe8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1556 microversion: 2.1 time: 0.383965 Sep 27 16:37:12.564966 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 42/89] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:12 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1556 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:12.584383 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7ea47e41-772c-4e30-84ba-6d92fe969885 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:12.585180 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7ea47e41-772c-4e30-84ba-6d92fe969885 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:12.592429 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ea47e41-772c-4e30-84ba-6d92fe969885 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:12.593120 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ea47e41-772c-4e30-84ba-6d92fe969885 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:12.593563 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ea47e41-772c-4e30-84ba-6d92fe969885 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:12.594437 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ea47e41-772c-4e30-84ba-6d92fe969885 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:12.595415 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ea47e41-772c-4e30-84ba-6d92fe969885 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:12.595939 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ea47e41-772c-4e30-84ba-6d92fe969885 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:12.723646 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7ea47e41-772c-4e30-84ba-6d92fe969885 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.142411 Sep 27 16:37:12.725881 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 48/90] 10.222.0.64 () {58 vars in 1275 bytes} [Tue Sep 27 16:37:12 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:37:13.196269 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-bf31bd5c-ae8a-4924-92ab-60fe90b4f592 req-228cf90b-a4d2-43b1-9727-05e1f715f3b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f84acf37-9445-48cd-a921-12a7a3c301d9", "tag": "184e6faa-be62-4210-acc1-64aceea7f1f0"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:37:13.214528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-bf31bd5c-ae8a-4924-92ab-60fe90b4f592 req-228cf90b-a4d2-43b1-9727-05e1f715f3b0 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:13.215109 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-bf31bd5c-ae8a-4924-92ab-60fe90b4f592 req-228cf90b-a4d2-43b1-9727-05e1f715f3b0 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:13.215973 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-bf31bd5c-ae8a-4924-92ab-60fe90b4f592 req-228cf90b-a4d2-43b1-9727-05e1f715f3b0 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:13.236911 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-bf31bd5c-ae8a-4924-92ab-60fe90b4f592 req-228cf90b-a4d2-43b1-9727-05e1f715f3b0 service nova] Creating event network-changed:184e6faa-be62-4210-acc1-64aceea7f1f0 for instance f84acf37-9445-48cd-a921-12a7a3c301d9 on hv-cinder-85506 Sep 27 16:37:13.251589 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-bf31bd5c-ae8a-4924-92ab-60fe90b4f592 req-228cf90b-a4d2-43b1-9727-05e1f715f3b0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056682 Sep 27 16:37:13.252682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 43/91] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:37:14.586147 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-7e9eb9a4-30ae-4e54-882d-24ee1bb7933f req-ccce64e9-783e-4b89-9048-a3da15f9586d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8010c1e5-fe22-4255-a8df-0f63551bb226", "tag": "28c38995-7f8b-4c47-85ed-9090cbdf348e"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:37:14.598178 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-7e9eb9a4-30ae-4e54-882d-24ee1bb7933f req-ccce64e9-783e-4b89-9048-a3da15f9586d service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:14.599001 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-7e9eb9a4-30ae-4e54-882d-24ee1bb7933f req-ccce64e9-783e-4b89-9048-a3da15f9586d service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:14.599575 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-7e9eb9a4-30ae-4e54-882d-24ee1bb7933f req-ccce64e9-783e-4b89-9048-a3da15f9586d service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:14.620491 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-7e9eb9a4-30ae-4e54-882d-24ee1bb7933f req-ccce64e9-783e-4b89-9048-a3da15f9586d service nova] Creating event network-changed:28c38995-7f8b-4c47-85ed-9090cbdf348e for instance 8010c1e5-fe22-4255-a8df-0f63551bb226 on hv-cinder-85506 Sep 27 16:37:14.626567 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-7e9eb9a4-30ae-4e54-882d-24ee1bb7933f req-ccce64e9-783e-4b89-9048-a3da15f9586d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044770 Sep 27 16:37:14.627660 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 49/92] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:37:25.375027 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bd9ad6bd-ee74-433a-8843-d2271e548312 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:25.376941 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bd9ad6bd-ee74-433a-8843-d2271e548312 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:25.385849 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=43 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:25.386887 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=17 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:25.388652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd9ad6bd-ee74-433a-8843-d2271e548312 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:25.389303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd9ad6bd-ee74-433a-8843-d2271e548312 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:25.389884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd9ad6bd-ee74-433a-8843-d2271e548312 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:25.390597 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd9ad6bd-ee74-433a-8843-d2271e548312 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:25.391081 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd9ad6bd-ee74-433a-8843-d2271e548312 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:25.391625 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd9ad6bd-ee74-433a-8843-d2271e548312 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:25.424104 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bd9ad6bd-ee74-433a-8843-d2271e548312 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 16:37:25.757680 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bd9ad6bd-ee74-433a-8843-d2271e548312 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 204 len: 0 microversion: 2.1 time: 0.387002 Sep 27 16:37:25.758282 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 44/93] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:37:25 2022] DELETE /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 16:37:25.765362 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=19 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:25.766111 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:25.770269 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d5d53e84-e85d-418e-bbd8-8989f53308a2 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:25.771003 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d5d53e84-e85d-418e-bbd8-8989f53308a2 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:25.777933 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d5d53e84-e85d-418e-bbd8-8989f53308a2 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:25.778606 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d5d53e84-e85d-418e-bbd8-8989f53308a2 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:25.779017 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d5d53e84-e85d-418e-bbd8-8989f53308a2 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:25.779726 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d5d53e84-e85d-418e-bbd8-8989f53308a2 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:25.780357 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d5d53e84-e85d-418e-bbd8-8989f53308a2 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:25.780782 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d5d53e84-e85d-418e-bbd8-8989f53308a2 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:25.930500 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d5d53e84-e85d-418e-bbd8-8989f53308a2 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:25.939873 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d5d53e84-e85d-418e-bbd8-8989f53308a2 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1554 microversion: 2.1 time: 0.175955 Sep 27 16:37:25.940484 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 50/94] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:25 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:37:26.965236 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a8083e03-f4d7-4ad8-840f-2058442ce572 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:26.965937 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a8083e03-f4d7-4ad8-840f-2058442ce572 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:26.973062 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8083e03-f4d7-4ad8-840f-2058442ce572 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:26.973572 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8083e03-f4d7-4ad8-840f-2058442ce572 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:26.974049 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8083e03-f4d7-4ad8-840f-2058442ce572 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:26.974768 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8083e03-f4d7-4ad8-840f-2058442ce572 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:26.975278 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8083e03-f4d7-4ad8-840f-2058442ce572 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:26.975777 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8083e03-f4d7-4ad8-840f-2058442ce572 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:27.140786 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a8083e03-f4d7-4ad8-840f-2058442ce572 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:27.153266 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a8083e03-f4d7-4ad8-840f-2058442ce572 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1554 microversion: 2.1 time: 0.192278 Sep 27 16:37:27.159583 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 45/95] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:26 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1554 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:28.177510 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f57bd568-3536-406d-83a5-52a07579eb55 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:28.178110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f57bd568-3536-406d-83a5-52a07579eb55 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:28.186718 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f57bd568-3536-406d-83a5-52a07579eb55 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:28.187186 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f57bd568-3536-406d-83a5-52a07579eb55 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:28.187975 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f57bd568-3536-406d-83a5-52a07579eb55 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:28.188926 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f57bd568-3536-406d-83a5-52a07579eb55 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:28.189394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f57bd568-3536-406d-83a5-52a07579eb55 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:28.189823 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f57bd568-3536-406d-83a5-52a07579eb55 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:28.433122 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f57bd568-3536-406d-83a5-52a07579eb55 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:28.441996 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f57bd568-3536-406d-83a5-52a07579eb55 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1554 microversion: 2.1 time: 0.268337 Sep 27 16:37:28.442556 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 51/96] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:28 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1554 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:28.815157 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-ac636671-552c-433e-becc-a15cf7aa3b7b req-59a55bc6-e06c-462b-af56-1e42249ac340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b665e8b-d6f6-4474-9066-70f12819fad1", "name": "network-vif-deleted", "tag": "598be294-4d75-4e83-9ef3-4c13b0a611d9"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:37:28.831948 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-ac636671-552c-433e-becc-a15cf7aa3b7b req-59a55bc6-e06c-462b-af56-1e42249ac340 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:28.832938 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-ac636671-552c-433e-becc-a15cf7aa3b7b req-59a55bc6-e06c-462b-af56-1e42249ac340 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:28.833772 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-ac636671-552c-433e-becc-a15cf7aa3b7b req-59a55bc6-e06c-462b-af56-1e42249ac340 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:28.852555 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-ac636671-552c-433e-becc-a15cf7aa3b7b req-59a55bc6-e06c-462b-af56-1e42249ac340 service nova] Creating event network-vif-deleted:598be294-4d75-4e83-9ef3-4c13b0a611d9 for instance 7b665e8b-d6f6-4474-9066-70f12819fad1 on hv-cinder-85506 Sep 27 16:37:28.861692 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-ac636671-552c-433e-becc-a15cf7aa3b7b req-59a55bc6-e06c-462b-af56-1e42249ac340 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050884 Sep 27 16:37:28.863297 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 46/97] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:37:29.469714 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2e7309bb-3e24-4e36-8a5b-e1d319e44c97 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:29.470485 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2e7309bb-3e24-4e36-8a5b-e1d319e44c97 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:29.482160 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e7309bb-3e24-4e36-8a5b-e1d319e44c97 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:29.482880 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e7309bb-3e24-4e36-8a5b-e1d319e44c97 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:29.483978 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e7309bb-3e24-4e36-8a5b-e1d319e44c97 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:29.484205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e7309bb-3e24-4e36-8a5b-e1d319e44c97 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:29.485178 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e7309bb-3e24-4e36-8a5b-e1d319e44c97 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:29.486197 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e7309bb-3e24-4e36-8a5b-e1d319e44c97 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:29.553589 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2e7309bb-3e24-4e36-8a5b-e1d319e44c97 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:29.562337 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2e7309bb-3e24-4e36-8a5b-e1d319e44c97 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1346 microversion: 2.1 time: 0.100852 Sep 27 16:37:29.562941 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 52/98] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:29 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:30.588545 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ac01b5ca-3469-485a-a950-a0efc3ad6075 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:30.589368 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ac01b5ca-3469-485a-a950-a0efc3ad6075 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:30.599988 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac01b5ca-3469-485a-a950-a0efc3ad6075 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:30.599988 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac01b5ca-3469-485a-a950-a0efc3ad6075 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:30.599988 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac01b5ca-3469-485a-a950-a0efc3ad6075 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:30.599988 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac01b5ca-3469-485a-a950-a0efc3ad6075 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:30.600356 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac01b5ca-3469-485a-a950-a0efc3ad6075 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:30.600441 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac01b5ca-3469-485a-a950-a0efc3ad6075 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:30.641343 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac01b5ca-3469-485a-a950-a0efc3ad6075 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:30.641974 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac01b5ca-3469-485a-a950-a0efc3ad6075 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:30.642437 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac01b5ca-3469-485a-a950-a0efc3ad6075 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:30.643055 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-ac01b5ca-3469-485a-a950-a0efc3ad6075 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lazy-loading 'fault' on Instance uuid 7b665e8b-d6f6-4474-9066-70f12819fad1 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:37:30.689972 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ac01b5ca-3469-485a-a950-a0efc3ad6075 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e263a6105642c1815e1c59429278f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '996f7fb4be7b42ceb08488b812087543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:30.698502 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ac01b5ca-3469-485a-a950-a0efc3ad6075 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 200 len: 1351 microversion: 2.1 time: 0.115690 Sep 27 16:37:30.699790 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 47/99] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:30 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 1351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:31.722355 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c1d1cb0c-50eb-4343-b561-b8ad8daa3aee tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:31.722998 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c1d1cb0c-50eb-4343-b561-b8ad8daa3aee tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:31.729563 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1d1cb0c-50eb-4343-b561-b8ad8daa3aee tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:31.730171 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1d1cb0c-50eb-4343-b561-b8ad8daa3aee tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:31.730619 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1d1cb0c-50eb-4343-b561-b8ad8daa3aee tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:31.731377 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1d1cb0c-50eb-4343-b561-b8ad8daa3aee tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:31.731945 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1d1cb0c-50eb-4343-b561-b8ad8daa3aee tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:31.732430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1d1cb0c-50eb-4343-b561-b8ad8daa3aee tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:31.747093 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-c1d1cb0c-50eb-4343-b561-b8ad8daa3aee tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] HTTP exception thrown: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. Sep 27 16:37:31.751809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c1d1cb0c-50eb-4343-b561-b8ad8daa3aee tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Request method failure captured: Sep 27 16:37:31.751809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 HTTP/1.1 Sep 27 16:37:31.751809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:37:31.751809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:37:31.751809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:37:31.751809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 27 16:37:31.751809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:37:31.751809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:37:31.751809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:37:31.751809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:37:31.751809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMyaPh_KdwGWxy3oOpa3ywKrS4-K66I6f4IoMcBz_1HK-WsGL33itxBJJcDTzFcE51PmX5uKG_s4AYnfGqM5KpIRzjc3Osq53EujgCHMNQhqfhIiouG41oDNTFlmMwiUE-Me8i6DvwtzftZvBfwSpLFsP30oi9rA03iYOVRQUMQX7Q28 Sep 27 16:37:31.751809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:37:31.751809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:37:31.751809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:37:31.751809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:37:31.751809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:37:31.751809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:37:31.751809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: 996f7fb4be7b42ceb08488b812087543 Sep 27 16:37:31.751809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-DeleteServersTestJSON-114233509 Sep 27 16:37:31.751809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:37:31.751809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:37:31.753303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/996f7fb4be7b42ceb08488b812087543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_996f7fb4be7b42ceb08488b812087543"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/996f7fb4be7b42ceb08488b812087543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/996f7fb4be7b42ceb08488b812087543"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:37:31.753303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-DeleteServersTestJSON-114233509 Sep 27 16:37:31.753303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 996f7fb4be7b42ceb08488b812087543 Sep 27 16:37:31.753303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-DeleteServersTestJSON-114233509 Sep 27 16:37:31.753303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-DeleteServersTestJSON-114233509-project Sep 27 16:37:31.753303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:37:31.753303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:37:31.753303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: 02e263a6105642c1815e1c59429278f7 Sep 27 16:37:31.753303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-DeleteServersTestJSON-114233509-project Sep 27 16:37:31.753303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: > Sep 27 16:37:31.753303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. Sep 27 16:37:31.753303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'id': '7b665e8b-d6f6-4474-9066-70f12819fad1'} Sep 27 16:37:31.754190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:37:31.754190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:37:31.754190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:37:31.754190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:37:31.754190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:37:31.754190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:37:31.754190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:37:31.754190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:37:31.754190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:37:31.754190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:37:31.754190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. Sep 27 16:37:31.754190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:37:31.754190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:37:31.754190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:37:31.754190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:37:31.754190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:37:31.754190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:37:31.754190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:37:31.754190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:37:31.754190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:37:31.755624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:37:31.755624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:37:31.755624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:37:31.755624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:37:31.755624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:37:31.755624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:37:31.755624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:37:31.755624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. Sep 27 16:37:31.755624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:37:31.755624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:37:31.755624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:37:31.755624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:37:31.755624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:37:31.755624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:37:31.755624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:37:31.755624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:37:31.755624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. Sep 27 16:37:31.755624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:37:31.756924 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c1d1cb0c-50eb-4343-b561-b8ad8daa3aee tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Returning 404 to user: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:37:31.756924 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c1d1cb0c-50eb-4343-b561-b8ad8daa3aee tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 404 len: 111 microversion: 2.1 time: 0.035343 Sep 27 16:37:31.756924 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 53/100] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:31 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:37:31.876325 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b5168447-e5a9-4b0a-8f6b-6797f0dda79f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:31.878466 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b5168447-e5a9-4b0a-8f6b-6797f0dda79f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:31.887726 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5168447-e5a9-4b0a-8f6b-6797f0dda79f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:31.888214 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5168447-e5a9-4b0a-8f6b-6797f0dda79f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:31.888660 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5168447-e5a9-4b0a-8f6b-6797f0dda79f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:31.889356 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5168447-e5a9-4b0a-8f6b-6797f0dda79f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:31.889819 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5168447-e5a9-4b0a-8f6b-6797f0dda79f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:31.890236 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5168447-e5a9-4b0a-8f6b-6797f0dda79f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:31.903219 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-b5168447-e5a9-4b0a-8f6b-6797f0dda79f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] HTTP exception thrown: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. Sep 27 16:37:31.907381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b5168447-e5a9-4b0a-8f6b-6797f0dda79f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Request method failure captured: Sep 27 16:37:31.907381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1/os-volume_attachments HTTP/1.1 Sep 27 16:37:31.907381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:37:31.907381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:37:31.907381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:37:31.907381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:37:31.907381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:37:31.907381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:37:31.907381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:37:31.907381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:37:31.907381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMyaPh_KdwGWxy3oOpa3ywKrS4-K66I6f4IoMcBz_1HK-WsGL33itxBJJcDTzFcE51PmX5uKG_s4AYnfGqM5KpIRzjc3Osq53EujgCHMNQhqfhIiouG41oDNTFlmMwiUE-Me8i6DvwtzftZvBfwSpLFsP30oi9rA03iYOVRQUMQX7Q28 Sep 27 16:37:31.907381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:37:31.907381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:37:31.907381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:37:31.907381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:37:31.907381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:37:31.907381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:37:31.907381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 996f7fb4be7b42ceb08488b812087543 Sep 27 16:37:31.907381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-DeleteServersTestJSON-114233509 Sep 27 16:37:31.907381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:37:31.907381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:37:31.908784 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/996f7fb4be7b42ceb08488b812087543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_996f7fb4be7b42ceb08488b812087543"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/996f7fb4be7b42ceb08488b812087543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/996f7fb4be7b42ceb08488b812087543"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:37:31.908784 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-DeleteServersTestJSON-114233509 Sep 27 16:37:31.908784 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 996f7fb4be7b42ceb08488b812087543 Sep 27 16:37:31.908784 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-DeleteServersTestJSON-114233509 Sep 27 16:37:31.908784 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-DeleteServersTestJSON-114233509-project Sep 27 16:37:31.908784 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:37:31.908784 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:37:31.908784 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: 02e263a6105642c1815e1c59429278f7 Sep 27 16:37:31.908784 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-DeleteServersTestJSON-114233509-project Sep 27 16:37:31.908784 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:37:31.908784 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. Sep 27 16:37:31.908784 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'server_id': '7b665e8b-d6f6-4474-9066-70f12819fad1'} Sep 27 16:37:31.909755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:37:31.909755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:37:31.909755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:37:31.909755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:37:31.909755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:37:31.909755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:37:31.909755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:37:31.909755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:37:31.909755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:37:31.909755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:37:31.909755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. Sep 27 16:37:31.909755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:37:31.909755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:37:31.909755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:37:31.909755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:37:31.909755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:37:31.909755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:37:31.909755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:37:31.909755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:37:31.909755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:37:31.910891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:37:31.910891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 16:37:31.910891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 16:37:31.910891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 16:37:31.910891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 16:37:31.910891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 27 16:37:31.910891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 27 16:37:31.910891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:37:31.910891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:37:31.910891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. Sep 27 16:37:31.910891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:37:31.910891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:37:31.910891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:37:31.910891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:37:31.910891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:37:31.910891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:37:31.910891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:37:31.910891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:37:31.910891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. Sep 27 16:37:31.910891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:37:31.912261 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b5168447-e5a9-4b0a-8f6b-6797f0dda79f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Returning 404 to user: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:37:31.912261 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b5168447-e5a9-4b0a-8f6b-6797f0dda79f tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036461 Sep 27 16:37:31.912261 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 48/101] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Sep 27 16:37:31 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 16:37:33.503568 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-755008c6-9045-460d-9e6e-7a61a09deff2 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:33.504068 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-755008c6-9045-460d-9e6e-7a61a09deff2 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:33.510664 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-755008c6-9045-460d-9e6e-7a61a09deff2 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:33.511176 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-755008c6-9045-460d-9e6e-7a61a09deff2 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:33.511643 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-755008c6-9045-460d-9e6e-7a61a09deff2 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:33.512414 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-755008c6-9045-460d-9e6e-7a61a09deff2 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:33.512862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-755008c6-9045-460d-9e6e-7a61a09deff2 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:33.513278 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-755008c6-9045-460d-9e6e-7a61a09deff2 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:33.526639 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-755008c6-9045-460d-9e6e-7a61a09deff2 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] HTTP exception thrown: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. Sep 27 16:37:33.528862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-755008c6-9045-460d-9e6e-7a61a09deff2 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Request method failure captured: Sep 27 16:37:33.528862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 HTTP/1.1 Sep 27 16:37:33.528862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:37:33.528862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:37:33.528862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:37:33.528862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 27 16:37:33.528862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:37:33.528862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:37:33.528862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:37:33.528862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:37:33.528862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMyaPh_KdwGWxy3oOpa3ywKrS4-K66I6f4IoMcBz_1HK-WsGL33itxBJJcDTzFcE51PmX5uKG_s4AYnfGqM5KpIRzjc3Osq53EujgCHMNQhqfhIiouG41oDNTFlmMwiUE-Me8i6DvwtzftZvBfwSpLFsP30oi9rA03iYOVRQUMQX7Q28 Sep 27 16:37:33.528862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:37:33.528862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:37:33.528862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:37:33.528862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:37:33.528862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:37:33.528862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:37:33.528862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: 996f7fb4be7b42ceb08488b812087543 Sep 27 16:37:33.528862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-DeleteServersTestJSON-114233509 Sep 27 16:37:33.528862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:37:33.528862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:37:33.530241 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/996f7fb4be7b42ceb08488b812087543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_996f7fb4be7b42ceb08488b812087543"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/996f7fb4be7b42ceb08488b812087543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/996f7fb4be7b42ceb08488b812087543"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:37:33.530241 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-DeleteServersTestJSON-114233509 Sep 27 16:37:33.530241 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 996f7fb4be7b42ceb08488b812087543 Sep 27 16:37:33.530241 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-DeleteServersTestJSON-114233509 Sep 27 16:37:33.530241 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-DeleteServersTestJSON-114233509-project Sep 27 16:37:33.530241 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:37:33.530241 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:37:33.530241 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: 02e263a6105642c1815e1c59429278f7 Sep 27 16:37:33.530241 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-DeleteServersTestJSON-114233509-project Sep 27 16:37:33.530241 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: > Sep 27 16:37:33.530241 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. Sep 27 16:37:33.530241 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'id': '7b665e8b-d6f6-4474-9066-70f12819fad1'} Sep 27 16:37:33.531110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:37:33.531110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:37:33.531110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:37:33.531110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:37:33.531110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:37:33.531110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:37:33.531110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:37:33.531110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:37:33.531110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:37:33.531110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:37:33.531110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. Sep 27 16:37:33.531110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:37:33.531110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:37:33.531110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:37:33.531110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:37:33.531110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:37:33.531110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:37:33.531110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:37:33.531110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:37:33.531110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:37:33.532477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:37:33.532477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 16:37:33.532477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 16:37:33.532477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 16:37:33.532477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 16:37:33.532477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:37:33.532477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:37:33.532477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:37:33.532477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:37:33.532477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. Sep 27 16:37:33.532477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:37:33.532477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:37:33.532477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:37:33.532477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:37:33.532477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:37:33.532477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:37:33.532477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:37:33.532477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:37:33.532477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. Sep 27 16:37:33.532477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:37:33.533822 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-755008c6-9045-460d-9e6e-7a61a09deff2 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Returning 404 to user: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:37:33.533822 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-755008c6-9045-460d-9e6e-7a61a09deff2 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 404 len: 111 microversion: 2.1 time: 0.030748 Sep 27 16:37:33.533822 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 54/102] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:37:33 2022] DELETE /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:37:33.539292 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a721e0a9-c5a2-47e8-a2d5-39bdd685e5d3 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:33.539910 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a721e0a9-c5a2-47e8-a2d5-39bdd685e5d3 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] [instance: 7b665e8b-d6f6-4474-9066-70f12819fad1] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:33.547959 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a721e0a9-c5a2-47e8-a2d5-39bdd685e5d3 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:33.548452 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a721e0a9-c5a2-47e8-a2d5-39bdd685e5d3 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:33.548882 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a721e0a9-c5a2-47e8-a2d5-39bdd685e5d3 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:33.549570 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a721e0a9-c5a2-47e8-a2d5-39bdd685e5d3 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:33.550025 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a721e0a9-c5a2-47e8-a2d5-39bdd685e5d3 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:33.555191 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a721e0a9-c5a2-47e8-a2d5-39bdd685e5d3 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:33.567937 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-a721e0a9-c5a2-47e8-a2d5-39bdd685e5d3 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] HTTP exception thrown: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. Sep 27 16:37:33.570141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a721e0a9-c5a2-47e8-a2d5-39bdd685e5d3 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Request method failure captured: Sep 27 16:37:33.570141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 HTTP/1.1 Sep 27 16:37:33.570141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:37:33.570141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:37:33.570141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:37:33.570141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:37:33.570141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:37:33.570141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:37:33.570141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:37:33.570141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:37:33.570141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMyaPh_KdwGWxy3oOpa3ywKrS4-K66I6f4IoMcBz_1HK-WsGL33itxBJJcDTzFcE51PmX5uKG_s4AYnfGqM5KpIRzjc3Osq53EujgCHMNQhqfhIiouG41oDNTFlmMwiUE-Me8i6DvwtzftZvBfwSpLFsP30oi9rA03iYOVRQUMQX7Q28 Sep 27 16:37:33.570141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:37:33.570141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:37:33.570141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:37:33.570141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:37:33.570141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:37:33.570141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:37:33.570141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 996f7fb4be7b42ceb08488b812087543 Sep 27 16:37:33.570141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-DeleteServersTestJSON-114233509 Sep 27 16:37:33.570141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:37:33.570141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:37:33.571592 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/996f7fb4be7b42ceb08488b812087543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_996f7fb4be7b42ceb08488b812087543"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/996f7fb4be7b42ceb08488b812087543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/996f7fb4be7b42ceb08488b812087543"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:37:33.571592 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-DeleteServersTestJSON-114233509 Sep 27 16:37:33.571592 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 996f7fb4be7b42ceb08488b812087543 Sep 27 16:37:33.571592 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-DeleteServersTestJSON-114233509 Sep 27 16:37:33.571592 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-DeleteServersTestJSON-114233509-project Sep 27 16:37:33.571592 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:37:33.571592 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:37:33.571592 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: 02e263a6105642c1815e1c59429278f7 Sep 27 16:37:33.571592 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-DeleteServersTestJSON-114233509-project Sep 27 16:37:33.571592 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:37:33.571592 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. Sep 27 16:37:33.571592 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': '7b665e8b-d6f6-4474-9066-70f12819fad1'} Sep 27 16:37:33.572415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:37:33.572415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:37:33.572415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:37:33.572415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:37:33.572415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:37:33.572415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:37:33.572415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:37:33.572415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:37:33.572415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:37:33.572415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:37:33.572415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. Sep 27 16:37:33.572415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:37:33.572415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:37:33.572415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:37:33.572415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:37:33.572415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:37:33.572415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:37:33.572415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:37:33.572415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:37:33.572415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:37:33.573689 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:37:33.573689 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:37:33.573689 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:37:33.573689 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:37:33.573689 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:37:33.573689 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:37:33.573689 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:37:33.573689 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. Sep 27 16:37:33.573689 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:37:33.573689 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:37:33.573689 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:37:33.573689 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:37:33.573689 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:37:33.573689 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:37:33.573689 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:37:33.573689 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:37:33.573689 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. Sep 27 16:37:33.573689 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:37:33.575012 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a721e0a9-c5a2-47e8-a2d5-39bdd685e5d3 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] Returning 404 to user: Instance 7b665e8b-d6f6-4474-9066-70f12819fad1 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:37:33.575012 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a721e0a9-c5a2-47e8-a2d5-39bdd685e5d3 tempest-DeleteServersTestJSON-114233509 tempest-DeleteServersTestJSON-114233509-project] 10.222.0.64 "GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1" status: 404 len: 111 microversion: 2.1 time: 0.036772 Sep 27 16:37:33.575012 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 49/103] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:33 2022] GET /compute/v2.1/servers/7b665e8b-d6f6-4474-9066-70f12819fad1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 16:37:47.254602 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=10 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:47.256288 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=22 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:47.386893 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c8a336e3-2f9f-4366-8240-9a892bef9660 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1707520480", "imageRef": "6908a343-46fa-4801-bfb5-7ad92ac26956", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:37:47.484677 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-c8a336e3-2f9f-4366-8240-9a892bef9660 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] validate_networks() for [('c69d5dae-8230-4d1b-853f-7ade2d011d4c', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 16:37:48.027975 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-c8a336e3-2f9f-4366-8240-9a892bef9660 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 16:37:48.028399 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-c8a336e3-2f9f-4366-8240-9a892bef9660 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 16:37:48.028880 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-c8a336e3-2f9f-4366-8240-9a892bef9660 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 16:37:48.029284 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-c8a336e3-2f9f-4366-8240-9a892bef9660 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 16:37:48.029695 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-c8a336e3-2f9f-4366-8240-9a892bef9660 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 16:37:48.047374 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c8a336e3-2f9f-4366-8240-9a892bef9660 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:48.047921 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c8a336e3-2f9f-4366-8240-9a892bef9660 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:48.048359 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c8a336e3-2f9f-4366-8240-9a892bef9660 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:48.049135 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c8a336e3-2f9f-4366-8240-9a892bef9660 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:48.049614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c8a336e3-2f9f-4366-8240-9a892bef9660 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:48.050086 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c8a336e3-2f9f-4366-8240-9a892bef9660 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:48.078800 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-c8a336e3-2f9f-4366-8240-9a892bef9660 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Getting quotas for project 9288b4e62bc945479636aec307a98746. Resources: {'instances', 'ram', 'cores'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:37:48.085015 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-c8a336e3-2f9f-4366-8240-9a892bef9660 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Getting quotas for user 2f9e55a3ff7c424dbd7a58f0eb92b8ce and project 9288b4e62bc945479636aec307a98746. Resources: {'instances', 'ram', 'cores'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:37:48.097133 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c8a336e3-2f9f-4366-8240-9a892bef9660 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 16:37:48.099926 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c8a336e3-2f9f-4366-8240-9a892bef9660 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6908a343-46fa-4801-bfb5-7ad92ac26956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 16:37:48.272895 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c8a336e3-2f9f-4366-8240-9a892bef9660 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.023411 Sep 27 16:37:48.274016 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 55/104] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Sep 27 16:37:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 16:37:48.295254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-baf63390-974e-4515-be32-d54ec63f5cb6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:48.296698 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-baf63390-974e-4515-be32-d54ec63f5cb6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:48.301263 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:48.302581 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:48.378084 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-baf63390-974e-4515-be32-d54ec63f5cb6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:48.385817 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-baf63390-974e-4515-be32-d54ec63f5cb6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1222 microversion: 2.1 time: 0.095510 Sep 27 16:37:48.410454 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 50/105] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:48 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1222 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:48.463043 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-64df5d8f-df9b-401f-a9b0-69f555a52802 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-281639190", "imageRef": "6908a343-46fa-4801-bfb5-7ad92ac26956", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:37:48.551036 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-64df5d8f-df9b-401f-a9b0-69f555a52802 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] validate_networks() for [('c69d5dae-8230-4d1b-853f-7ade2d011d4c', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 16:37:48.947759 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-64df5d8f-df9b-401f-a9b0-69f555a52802 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 16:37:48.950799 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-64df5d8f-df9b-401f-a9b0-69f555a52802 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 16:37:48.951565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-64df5d8f-df9b-401f-a9b0-69f555a52802 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 16:37:48.951986 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-64df5d8f-df9b-401f-a9b0-69f555a52802 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 16:37:48.952434 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-64df5d8f-df9b-401f-a9b0-69f555a52802 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 16:37:48.965476 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-64df5d8f-df9b-401f-a9b0-69f555a52802 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:48.965958 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-64df5d8f-df9b-401f-a9b0-69f555a52802 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:48.966490 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-64df5d8f-df9b-401f-a9b0-69f555a52802 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:48.967461 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-64df5d8f-df9b-401f-a9b0-69f555a52802 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:48.967921 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-64df5d8f-df9b-401f-a9b0-69f555a52802 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:48.968476 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-64df5d8f-df9b-401f-a9b0-69f555a52802 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:48.988289 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-64df5d8f-df9b-401f-a9b0-69f555a52802 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Getting quotas for project 9288b4e62bc945479636aec307a98746. Resources: {'instances', 'ram', 'cores'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:37:48.991773 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-64df5d8f-df9b-401f-a9b0-69f555a52802 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Getting quotas for user 2f9e55a3ff7c424dbd7a58f0eb92b8ce and project 9288b4e62bc945479636aec307a98746. Resources: {'instances', 'ram', 'cores'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:37:49.003705 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-64df5d8f-df9b-401f-a9b0-69f555a52802 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 16:37:49.009080 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-64df5d8f-df9b-401f-a9b0-69f555a52802 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6908a343-46fa-4801-bfb5-7ad92ac26956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 16:37:49.234318 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-64df5d8f-df9b-401f-a9b0-69f555a52802 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.776480 Sep 27 16:37:49.234997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 56/106] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Sep 27 16:37:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 16:37:49.247566 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-52c553ea-c013-43e4-86f6-de4e49c3c0ac tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:49.248382 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-52c553ea-c013-43e4-86f6-de4e49c3c0ac tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:49.403088 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-52c553ea-c013-43e4-86f6-de4e49c3c0ac tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:49.416446 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-52c553ea-c013-43e4-86f6-de4e49c3c0ac tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1221 microversion: 2.1 time: 0.174040 Sep 27 16:37:49.429455 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 51/107] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:49 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1221 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:50.440411 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-52b25c63-45ec-4635-8bcc-7b6e9389c4e9 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:50.441587 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-52b25c63-45ec-4635-8bcc-7b6e9389c4e9 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:50.448126 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-52b25c63-45ec-4635-8bcc-7b6e9389c4e9 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:50.449225 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-52b25c63-45ec-4635-8bcc-7b6e9389c4e9 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:50.449658 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-52b25c63-45ec-4635-8bcc-7b6e9389c4e9 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:50.450397 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-52b25c63-45ec-4635-8bcc-7b6e9389c4e9 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:50.450878 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-52b25c63-45ec-4635-8bcc-7b6e9389c4e9 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:50.451295 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-52b25c63-45ec-4635-8bcc-7b6e9389c4e9 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:50.514693 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-52b25c63-45ec-4635-8bcc-7b6e9389c4e9 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:50.522570 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-52b25c63-45ec-4635-8bcc-7b6e9389c4e9 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1225 microversion: 2.1 time: 0.086406 Sep 27 16:37:50.523392 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 57/108] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:50 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:37:51.549107 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5c725138-38f8-471e-beac-c6e82ec08556 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:51.550431 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5c725138-38f8-471e-beac-c6e82ec08556 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:51.559076 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c725138-38f8-471e-beac-c6e82ec08556 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:51.559800 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c725138-38f8-471e-beac-c6e82ec08556 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:51.560302 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c725138-38f8-471e-beac-c6e82ec08556 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:51.561115 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c725138-38f8-471e-beac-c6e82ec08556 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:51.561634 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c725138-38f8-471e-beac-c6e82ec08556 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:51.562123 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c725138-38f8-471e-beac-c6e82ec08556 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:51.650048 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5c725138-38f8-471e-beac-c6e82ec08556 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:51.663317 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5c725138-38f8-471e-beac-c6e82ec08556 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1217 microversion: 2.1 time: 0.115912 Sep 27 16:37:51.663317 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 52/109] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:51 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1217 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:52.686334 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-369c1e82-fac9-460b-83c9-e986c202c58b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:52.687286 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-369c1e82-fac9-460b-83c9-e986c202c58b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:52.694343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-369c1e82-fac9-460b-83c9-e986c202c58b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:52.694860 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-369c1e82-fac9-460b-83c9-e986c202c58b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:52.695352 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-369c1e82-fac9-460b-83c9-e986c202c58b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:52.696059 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-369c1e82-fac9-460b-83c9-e986c202c58b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:52.696514 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-369c1e82-fac9-460b-83c9-e986c202c58b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:52.699399 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-369c1e82-fac9-460b-83c9-e986c202c58b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:52.772145 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-369c1e82-fac9-460b-83c9-e986c202c58b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:52.781140 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-369c1e82-fac9-460b-83c9-e986c202c58b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1273 microversion: 2.1 time: 0.099409 Sep 27 16:37:52.791557 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 58/110] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:52 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1273 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:53.804771 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6caff5d9-731a-4c88-872b-664d0bd41ef3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:53.805385 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6caff5d9-731a-4c88-872b-664d0bd41ef3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:53.812640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6caff5d9-731a-4c88-872b-664d0bd41ef3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:53.813120 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6caff5d9-731a-4c88-872b-664d0bd41ef3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:53.820612 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6caff5d9-731a-4c88-872b-664d0bd41ef3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:53.820612 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6caff5d9-731a-4c88-872b-664d0bd41ef3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:53.820612 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6caff5d9-731a-4c88-872b-664d0bd41ef3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:53.820612 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6caff5d9-731a-4c88-872b-664d0bd41ef3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:53.883764 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6caff5d9-731a-4c88-872b-664d0bd41ef3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:53.892682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6caff5d9-731a-4c88-872b-664d0bd41ef3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1281 microversion: 2.1 time: 0.091780 Sep 27 16:37:53.893255 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 53/111] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:53 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1281 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:54.915885 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6d32de22-76bf-4bab-8206-b095e364479d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:54.916526 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6d32de22-76bf-4bab-8206-b095e364479d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:54.923225 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d32de22-76bf-4bab-8206-b095e364479d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:54.923702 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d32de22-76bf-4bab-8206-b095e364479d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:54.924224 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d32de22-76bf-4bab-8206-b095e364479d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:54.924964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d32de22-76bf-4bab-8206-b095e364479d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:54.925406 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d32de22-76bf-4bab-8206-b095e364479d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:54.925845 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d32de22-76bf-4bab-8206-b095e364479d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:54.991451 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6d32de22-76bf-4bab-8206-b095e364479d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:54.999109 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6d32de22-76bf-4bab-8206-b095e364479d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1281 microversion: 2.1 time: 0.086962 Sep 27 16:37:55.000704 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 59/112] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:54 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1281 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:56.025855 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c195891a-f59e-4f80-97ac-242d6380cf61 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:56.027843 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c195891a-f59e-4f80-97ac-242d6380cf61 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:56.034482 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c195891a-f59e-4f80-97ac-242d6380cf61 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:56.035007 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c195891a-f59e-4f80-97ac-242d6380cf61 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:56.035528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c195891a-f59e-4f80-97ac-242d6380cf61 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:56.036742 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c195891a-f59e-4f80-97ac-242d6380cf61 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:56.037234 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c195891a-f59e-4f80-97ac-242d6380cf61 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:56.037715 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c195891a-f59e-4f80-97ac-242d6380cf61 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:56.112029 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c195891a-f59e-4f80-97ac-242d6380cf61 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:56.121567 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c195891a-f59e-4f80-97ac-242d6380cf61 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1291 microversion: 2.1 time: 0.102118 Sep 27 16:37:56.122172 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 54/113] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:56 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1291 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:56.689190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-8197b197-ac93-4015-a521-e92e06afe713 req-2bf25177-55c0-4bbe-973c-5c1ee3bac3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35d1f4b1-f536-4f56-8c18-400be343444b", "tag": "9a2e9512-fd72-4935-9024-5d91227158e5"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:37:56.703277 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-8197b197-ac93-4015-a521-e92e06afe713 req-2bf25177-55c0-4bbe-973c-5c1ee3bac3e3 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:56.704094 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-8197b197-ac93-4015-a521-e92e06afe713 req-2bf25177-55c0-4bbe-973c-5c1ee3bac3e3 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:56.705313 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-8197b197-ac93-4015-a521-e92e06afe713 req-2bf25177-55c0-4bbe-973c-5c1ee3bac3e3 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:56.720407 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-8197b197-ac93-4015-a521-e92e06afe713 req-2bf25177-55c0-4bbe-973c-5c1ee3bac3e3 service nova] Creating event network-changed:9a2e9512-fd72-4935-9024-5d91227158e5 for instance 35d1f4b1-f536-4f56-8c18-400be343444b on hv-cinder-85506 Sep 27 16:37:56.726556 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-8197b197-ac93-4015-a521-e92e06afe713 req-2bf25177-55c0-4bbe-973c-5c1ee3bac3e3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052145 Sep 27 16:37:56.726818 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 60/114] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:37:57.145087 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fef870c9-21a2-42f5-a38c-6ae6142dbea2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:57.148204 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fef870c9-21a2-42f5-a38c-6ae6142dbea2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:57.156071 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fef870c9-21a2-42f5-a38c-6ae6142dbea2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:57.156802 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fef870c9-21a2-42f5-a38c-6ae6142dbea2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:57.157398 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fef870c9-21a2-42f5-a38c-6ae6142dbea2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:57.158258 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fef870c9-21a2-42f5-a38c-6ae6142dbea2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:57.158880 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fef870c9-21a2-42f5-a38c-6ae6142dbea2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:57.159469 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fef870c9-21a2-42f5-a38c-6ae6142dbea2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:57.582070 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fef870c9-21a2-42f5-a38c-6ae6142dbea2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:57.601144 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fef870c9-21a2-42f5-a38c-6ae6142dbea2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1321 microversion: 2.1 time: 0.459947 Sep 27 16:37:57.608927 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 55/115] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:57 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1321 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:58.281525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-dc0134ce-3d89-44be-ae28-858fdb8d00a7 req-0d07c53b-3880-4f9a-a104-1fa3ef07b3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666", "tag": "207d0a14-eef1-4291-ac34-12fd2700d04d"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:37:58.294858 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-dc0134ce-3d89-44be-ae28-858fdb8d00a7 req-0d07c53b-3880-4f9a-a104-1fa3ef07b3c6 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:58.295394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-dc0134ce-3d89-44be-ae28-858fdb8d00a7 req-0d07c53b-3880-4f9a-a104-1fa3ef07b3c6 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:58.295878 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-dc0134ce-3d89-44be-ae28-858fdb8d00a7 req-0d07c53b-3880-4f9a-a104-1fa3ef07b3c6 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:58.310085 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-dc0134ce-3d89-44be-ae28-858fdb8d00a7 req-0d07c53b-3880-4f9a-a104-1fa3ef07b3c6 service nova] Creating event network-changed:207d0a14-eef1-4291-ac34-12fd2700d04d for instance 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 on hv-cinder-85506 Sep 27 16:37:58.315518 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-dc0134ce-3d89-44be-ae28-858fdb8d00a7 req-0d07c53b-3880-4f9a-a104-1fa3ef07b3c6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042008 Sep 27 16:37:58.316643 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 61/116] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:37:58.635986 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1af956b0-c64d-466e-8e87-73e12194e8cd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:58.636817 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1af956b0-c64d-466e-8e87-73e12194e8cd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:58.642861 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1af956b0-c64d-466e-8e87-73e12194e8cd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:58.643421 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1af956b0-c64d-466e-8e87-73e12194e8cd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:58.643921 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1af956b0-c64d-466e-8e87-73e12194e8cd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:58.644772 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1af956b0-c64d-466e-8e87-73e12194e8cd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:58.645286 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1af956b0-c64d-466e-8e87-73e12194e8cd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:58.645782 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1af956b0-c64d-466e-8e87-73e12194e8cd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:58.787731 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1af956b0-c64d-466e-8e87-73e12194e8cd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:37:58.796399 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1af956b0-c64d-466e-8e87-73e12194e8cd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1321 microversion: 2.1 time: 0.164253 Sep 27 16:37:58.797412 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 56/117] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:58 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:37:59.822110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0be2d352-ce97-45eb-a5e8-08bf38d4652b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:37:59.824320 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0be2d352-ce97-45eb-a5e8-08bf38d4652b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:37:59.829738 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=4 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:59.830574 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=12 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:37:59.837094 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0be2d352-ce97-45eb-a5e8-08bf38d4652b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:59.838291 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0be2d352-ce97-45eb-a5e8-08bf38d4652b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:59.839638 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0be2d352-ce97-45eb-a5e8-08bf38d4652b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:59.841038 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0be2d352-ce97-45eb-a5e8-08bf38d4652b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:37:59.842487 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0be2d352-ce97-45eb-a5e8-08bf38d4652b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:37:59.843121 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0be2d352-ce97-45eb-a5e8-08bf38d4652b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:37:59.993301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0be2d352-ce97-45eb-a5e8-08bf38d4652b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:00.002056 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0be2d352-ce97-45eb-a5e8-08bf38d4652b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1321 microversion: 2.1 time: 0.184640 Sep 27 16:38:00.002638 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 62/118] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:37:59 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:01.025112 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a3244e39-0069-4948-987a-cc1a1c8d8feb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:01.025719 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a3244e39-0069-4948-987a-cc1a1c8d8feb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:01.027915 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=4 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:01.032636 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a3244e39-0069-4948-987a-cc1a1c8d8feb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:01.033116 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a3244e39-0069-4948-987a-cc1a1c8d8feb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:01.033548 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a3244e39-0069-4948-987a-cc1a1c8d8feb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:01.034233 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a3244e39-0069-4948-987a-cc1a1c8d8feb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:01.034982 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a3244e39-0069-4948-987a-cc1a1c8d8feb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:01.040045 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a3244e39-0069-4948-987a-cc1a1c8d8feb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:01.196151 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a3244e39-0069-4948-987a-cc1a1c8d8feb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:01.204535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a3244e39-0069-4948-987a-cc1a1c8d8feb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1321 microversion: 2.1 time: 0.183339 Sep 27 16:38:01.205110 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 57/119] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:01 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:02.232442 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-974a0157-b67b-4c32-8587-e40e0ee3a282 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:02.233861 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-974a0157-b67b-4c32-8587-e40e0ee3a282 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:02.242319 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-974a0157-b67b-4c32-8587-e40e0ee3a282 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:02.243118 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-974a0157-b67b-4c32-8587-e40e0ee3a282 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:02.243730 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-974a0157-b67b-4c32-8587-e40e0ee3a282 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:02.244816 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-974a0157-b67b-4c32-8587-e40e0ee3a282 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:02.246262 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-974a0157-b67b-4c32-8587-e40e0ee3a282 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:02.246744 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-974a0157-b67b-4c32-8587-e40e0ee3a282 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:02.547543 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-974a0157-b67b-4c32-8587-e40e0ee3a282 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:02.556317 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-974a0157-b67b-4c32-8587-e40e0ee3a282 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1321 microversion: 2.1 time: 0.331181 Sep 27 16:38:02.557079 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 63/120] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:02 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:03.588130 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c444742b-2680-4b77-a30b-cbd8cafa696c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:03.589846 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c444742b-2680-4b77-a30b-cbd8cafa696c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:03.597355 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c444742b-2680-4b77-a30b-cbd8cafa696c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:03.598120 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c444742b-2680-4b77-a30b-cbd8cafa696c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:03.598576 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c444742b-2680-4b77-a30b-cbd8cafa696c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:03.599328 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c444742b-2680-4b77-a30b-cbd8cafa696c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:03.599980 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c444742b-2680-4b77-a30b-cbd8cafa696c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:03.600400 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c444742b-2680-4b77-a30b-cbd8cafa696c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:03.752532 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c444742b-2680-4b77-a30b-cbd8cafa696c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:03.763199 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c444742b-2680-4b77-a30b-cbd8cafa696c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1321 microversion: 2.1 time: 0.182387 Sep 27 16:38:03.765042 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 58/121] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:03 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:04.554318 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b6d44f61-b8ad-40b7-b3e4-309e5300a3fd tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-835139797", "imageRef": "6908a343-46fa-4801-bfb5-7ad92ac26956", "flavorRef": "452"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:04.619800 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-b6d44f61-b8ad-40b7-b3e4-309e5300a3fd tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] validate_networks() for None {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 16:38:04.795145 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-519a09af-d79c-48c7-b6f4-9e2bf738e5c6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:04.795145 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-519a09af-d79c-48c7-b6f4-9e2bf738e5c6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:04.795988 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-519a09af-d79c-48c7-b6f4-9e2bf738e5c6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:04.796476 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-519a09af-d79c-48c7-b6f4-9e2bf738e5c6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:04.797472 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-519a09af-d79c-48c7-b6f4-9e2bf738e5c6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:04.799323 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-519a09af-d79c-48c7-b6f4-9e2bf738e5c6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:04.800418 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-519a09af-d79c-48c7-b6f4-9e2bf738e5c6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:04.801170 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-519a09af-d79c-48c7-b6f4-9e2bf738e5c6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:04.980001 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-b6d44f61-b8ad-40b7-b3e4-309e5300a3fd tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 16:38:04.980953 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-b6d44f61-b8ad-40b7-b3e4-309e5300a3fd tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 16:38:04.981673 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-b6d44f61-b8ad-40b7-b3e4-309e5300a3fd tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 16:38:04.982661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-b6d44f61-b8ad-40b7-b3e4-309e5300a3fd tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 16:38:04.987351 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-b6d44f61-b8ad-40b7-b3e4-309e5300a3fd tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 16:38:05.006241 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b6d44f61-b8ad-40b7-b3e4-309e5300a3fd tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:05.006241 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b6d44f61-b8ad-40b7-b3e4-309e5300a3fd tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:05.006241 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b6d44f61-b8ad-40b7-b3e4-309e5300a3fd tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:05.006947 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b6d44f61-b8ad-40b7-b3e4-309e5300a3fd tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:05.007542 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b6d44f61-b8ad-40b7-b3e4-309e5300a3fd tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:05.011752 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b6d44f61-b8ad-40b7-b3e4-309e5300a3fd tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:05.021523 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-519a09af-d79c-48c7-b6f4-9e2bf738e5c6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:05.031768 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-b6d44f61-b8ad-40b7-b3e4-309e5300a3fd tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Getting quotas for project 808169451dd64aa1a6a656ed9abbe5a0. Resources: {'instances', 'ram', 'cores'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:38:05.036489 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-b6d44f61-b8ad-40b7-b3e4-309e5300a3fd tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Getting quotas for user e1036377d4d94bb3a929aee17ca5eeec and project 808169451dd64aa1a6a656ed9abbe5a0. Resources: {'instances', 'ram', 'cores'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:38:05.039097 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-519a09af-d79c-48c7-b6f4-9e2bf738e5c6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1321 microversion: 2.1 time: 0.255507 Sep 27 16:38:05.041491 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 59/122] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:04 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:05.048002 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b6d44f61-b8ad-40b7-b3e4-309e5300a3fd tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 16:38:05.050567 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b6d44f61-b8ad-40b7-b3e4-309e5300a3fd tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6908a343-46fa-4801-bfb5-7ad92ac26956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 16:38:05.230462 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b6d44f61-b8ad-40b7-b3e4-309e5300a3fd tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.684557 Sep 27 16:38:05.231293 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 64/123] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Sep 27 16:38:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 16:38:05.242672 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-29fa406d-a845-4fc3-aff8-216e34cc4743 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:05.244289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-29fa406d-a845-4fc3-aff8-216e34cc4743 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:05.318522 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-29fa406d-a845-4fc3-aff8-216e34cc4743 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1036377d4d94bb3a929aee17ca5eeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808169451dd64aa1a6a656ed9abbe5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:05.326110 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-29fa406d-a845-4fc3-aff8-216e34cc4743 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 200 len: 1214 microversion: 2.1 time: 0.087438 Sep 27 16:38:05.326680 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 60/124] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:05 2022] GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:38:06.071746 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-337701c6-8f00-4cce-b1b8-3d6869ca4147 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:06.072489 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-337701c6-8f00-4cce-b1b8-3d6869ca4147 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:06.080596 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-337701c6-8f00-4cce-b1b8-3d6869ca4147 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:06.081086 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-337701c6-8f00-4cce-b1b8-3d6869ca4147 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:06.081912 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-337701c6-8f00-4cce-b1b8-3d6869ca4147 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:06.082528 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-337701c6-8f00-4cce-b1b8-3d6869ca4147 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:06.083003 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-337701c6-8f00-4cce-b1b8-3d6869ca4147 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:06.083581 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-337701c6-8f00-4cce-b1b8-3d6869ca4147 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:06.263131 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-8a42fa9c-11f8-4dee-b1b3-e5e6fed96dc6 req-2861bfce-9c0f-4b30-b4db-0af3c6151901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35d1f4b1-f536-4f56-8c18-400be343444b", "name": "network-vif-plugged", "status": "completed", "tag": "9a2e9512-fd72-4935-9024-5d91227158e5"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:06.278429 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8a42fa9c-11f8-4dee-b1b3-e5e6fed96dc6 req-2861bfce-9c0f-4b30-b4db-0af3c6151901 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:06.279215 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8a42fa9c-11f8-4dee-b1b3-e5e6fed96dc6 req-2861bfce-9c0f-4b30-b4db-0af3c6151901 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:06.279764 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8a42fa9c-11f8-4dee-b1b3-e5e6fed96dc6 req-2861bfce-9c0f-4b30-b4db-0af3c6151901 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:06.294168 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-8a42fa9c-11f8-4dee-b1b3-e5e6fed96dc6 req-2861bfce-9c0f-4b30-b4db-0af3c6151901 service nova] Creating event network-vif-plugged:9a2e9512-fd72-4935-9024-5d91227158e5 for instance 35d1f4b1-f536-4f56-8c18-400be343444b on hv-cinder-85506 Sep 27 16:38:06.301750 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-8a42fa9c-11f8-4dee-b1b3-e5e6fed96dc6 req-2861bfce-9c0f-4b30-b4db-0af3c6151901 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045558 Sep 27 16:38:06.302734 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 61/125] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:38:06.360308 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0850d68c-d3c1-4e9c-a43b-1a255e7b8478 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:06.360752 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-337701c6-8f00-4cce-b1b8-3d6869ca4147 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:06.361644 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0850d68c-d3c1-4e9c-a43b-1a255e7b8478 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:06.375197 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-337701c6-8f00-4cce-b1b8-3d6869ca4147 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1321 microversion: 2.1 time: 0.308114 Sep 27 16:38:06.375987 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 65/126] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:06 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:06.466995 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0850d68c-d3c1-4e9c-a43b-1a255e7b8478 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1036377d4d94bb3a929aee17ca5eeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808169451dd64aa1a6a656ed9abbe5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:06.474254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0850d68c-d3c1-4e9c-a43b-1a255e7b8478 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 200 len: 1214 microversion: 2.1 time: 0.125130 Sep 27 16:38:06.475163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 62/127] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:06 2022] GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:07.397543 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-725a34e8-2950-4d9f-8417-c3bbce16b80e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:07.398170 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-725a34e8-2950-4d9f-8417-c3bbce16b80e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:07.404979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-725a34e8-2950-4d9f-8417-c3bbce16b80e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:07.405464 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-725a34e8-2950-4d9f-8417-c3bbce16b80e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:07.405892 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-725a34e8-2950-4d9f-8417-c3bbce16b80e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:07.406627 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-725a34e8-2950-4d9f-8417-c3bbce16b80e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:07.407099 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-725a34e8-2950-4d9f-8417-c3bbce16b80e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:07.407519 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-725a34e8-2950-4d9f-8417-c3bbce16b80e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:07.497658 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b54594d9-febc-42d2-9911-f56066607884 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:07.498280 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b54594d9-febc-42d2-9911-f56066607884 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:07.508320 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b54594d9-febc-42d2-9911-f56066607884 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:07.510026 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b54594d9-febc-42d2-9911-f56066607884 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:07.510026 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b54594d9-febc-42d2-9911-f56066607884 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:07.510210 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b54594d9-febc-42d2-9911-f56066607884 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:07.511311 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b54594d9-febc-42d2-9911-f56066607884 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:07.511889 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b54594d9-febc-42d2-9911-f56066607884 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:07.585016 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-725a34e8-2950-4d9f-8417-c3bbce16b80e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:07.585568 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b54594d9-febc-42d2-9911-f56066607884 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1036377d4d94bb3a929aee17ca5eeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808169451dd64aa1a6a656ed9abbe5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:07.594151 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-725a34e8-2950-4d9f-8417-c3bbce16b80e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1321 microversion: 2.1 time: 0.200526 Sep 27 16:38:07.595224 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 66/128] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:07 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:07.595722 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b54594d9-febc-42d2-9911-f56066607884 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 200 len: 1210 microversion: 2.1 time: 0.102296 Sep 27 16:38:07.596315 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 63/129] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:07 2022] GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:38:08.318304 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-39fd3027-6f1c-4dfd-8e5c-fdee582f2cf6 req-ceec7e90-e9f6-4e22-9374-9f9e032f3005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666", "name": "network-vif-plugged", "status": "completed", "tag": "207d0a14-eef1-4291-ac34-12fd2700d04d"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:08.328076 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-39fd3027-6f1c-4dfd-8e5c-fdee582f2cf6 req-ceec7e90-e9f6-4e22-9374-9f9e032f3005 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:08.332534 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-39fd3027-6f1c-4dfd-8e5c-fdee582f2cf6 req-ceec7e90-e9f6-4e22-9374-9f9e032f3005 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:08.332534 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-39fd3027-6f1c-4dfd-8e5c-fdee582f2cf6 req-ceec7e90-e9f6-4e22-9374-9f9e032f3005 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:08.341058 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-39fd3027-6f1c-4dfd-8e5c-fdee582f2cf6 req-ceec7e90-e9f6-4e22-9374-9f9e032f3005 service nova] Creating event network-vif-plugged:207d0a14-eef1-4291-ac34-12fd2700d04d for instance 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 on hv-cinder-85506 Sep 27 16:38:08.346310 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-39fd3027-6f1c-4dfd-8e5c-fdee582f2cf6 req-ceec7e90-e9f6-4e22-9374-9f9e032f3005 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031566 Sep 27 16:38:08.346762 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 67/130] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:38:08.627524 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-01181007-9e21-4cdd-a26f-c6ff43828935 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:08.629382 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-26be83ac-5c0e-4834-a27b-39057944657f tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:08.630999 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-26be83ac-5c0e-4834-a27b-39057944657f tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:08.633924 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-01181007-9e21-4cdd-a26f-c6ff43828935 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:08.641005 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01181007-9e21-4cdd-a26f-c6ff43828935 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:08.641211 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26be83ac-5c0e-4834-a27b-39057944657f tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:08.641896 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01181007-9e21-4cdd-a26f-c6ff43828935 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:08.642431 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26be83ac-5c0e-4834-a27b-39057944657f tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:08.642854 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01181007-9e21-4cdd-a26f-c6ff43828935 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:08.643197 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26be83ac-5c0e-4834-a27b-39057944657f tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:08.643950 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01181007-9e21-4cdd-a26f-c6ff43828935 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:08.644590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01181007-9e21-4cdd-a26f-c6ff43828935 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:08.645058 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26be83ac-5c0e-4834-a27b-39057944657f tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:08.645399 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01181007-9e21-4cdd-a26f-c6ff43828935 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:08.645948 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26be83ac-5c0e-4834-a27b-39057944657f tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:08.646647 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26be83ac-5c0e-4834-a27b-39057944657f tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:08.830183 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-26be83ac-5c0e-4834-a27b-39057944657f tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1036377d4d94bb3a929aee17ca5eeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808169451dd64aa1a6a656ed9abbe5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:08.845483 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-26be83ac-5c0e-4834-a27b-39057944657f tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 200 len: 1266 microversion: 2.1 time: 0.222881 Sep 27 16:38:08.859420 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 68/131] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:08 2022] GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:08.960169 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-01181007-9e21-4cdd-a26f-c6ff43828935 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:08.977794 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-01181007-9e21-4cdd-a26f-c6ff43828935 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1321 microversion: 2.1 time: 0.358440 Sep 27 16:38:08.977794 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 64/132] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:08 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1321 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:09.874535 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f3d68de6-4051-4918-8ef6-a110c10f1953 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:09.875181 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f3d68de6-4051-4918-8ef6-a110c10f1953 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:09.886961 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3d68de6-4051-4918-8ef6-a110c10f1953 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:09.889024 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3d68de6-4051-4918-8ef6-a110c10f1953 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:09.889678 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3d68de6-4051-4918-8ef6-a110c10f1953 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:09.890695 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3d68de6-4051-4918-8ef6-a110c10f1953 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:09.891178 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3d68de6-4051-4918-8ef6-a110c10f1953 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:09.891790 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3d68de6-4051-4918-8ef6-a110c10f1953 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:09.966886 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f3d68de6-4051-4918-8ef6-a110c10f1953 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1036377d4d94bb3a929aee17ca5eeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808169451dd64aa1a6a656ed9abbe5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:09.974641 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f3d68de6-4051-4918-8ef6-a110c10f1953 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 200 len: 1274 microversion: 2.1 time: 0.106830 Sep 27 16:38:09.975256 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 69/133] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:09 2022] GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 1274 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:10.000234 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ccbb8c96-2967-4a51-8710-b52c05d7fb98 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:10.001901 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ccbb8c96-2967-4a51-8710-b52c05d7fb98 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:10.008737 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ccbb8c96-2967-4a51-8710-b52c05d7fb98 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:10.009437 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ccbb8c96-2967-4a51-8710-b52c05d7fb98 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:10.010018 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ccbb8c96-2967-4a51-8710-b52c05d7fb98 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:10.010991 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ccbb8c96-2967-4a51-8710-b52c05d7fb98 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:10.011611 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ccbb8c96-2967-4a51-8710-b52c05d7fb98 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:10.012185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ccbb8c96-2967-4a51-8710-b52c05d7fb98 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:10.266946 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ccbb8c96-2967-4a51-8710-b52c05d7fb98 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:10.283318 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ccbb8c96-2967-4a51-8710-b52c05d7fb98 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1321 microversion: 2.1 time: 0.286026 Sep 27 16:38:10.284355 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 65/134] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:09 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:11.012272 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5ff63e82-7249-4289-b0e4-24daa20be63e tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:11.014178 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5ff63e82-7249-4289-b0e4-24daa20be63e tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:11.031893 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ff63e82-7249-4289-b0e4-24daa20be63e tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:11.032689 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ff63e82-7249-4289-b0e4-24daa20be63e tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:11.035918 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ff63e82-7249-4289-b0e4-24daa20be63e tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:11.036963 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ff63e82-7249-4289-b0e4-24daa20be63e tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:11.038541 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ff63e82-7249-4289-b0e4-24daa20be63e tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:11.042554 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ff63e82-7249-4289-b0e4-24daa20be63e tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:11.306653 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4e4ffcd4-91a0-427c-a84d-92d13e234323 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:11.307811 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4e4ffcd4-91a0-427c-a84d-92d13e234323 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:11.318116 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e4ffcd4-91a0-427c-a84d-92d13e234323 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:11.318616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e4ffcd4-91a0-427c-a84d-92d13e234323 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:11.319089 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e4ffcd4-91a0-427c-a84d-92d13e234323 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:11.324416 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e4ffcd4-91a0-427c-a84d-92d13e234323 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:11.325139 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e4ffcd4-91a0-427c-a84d-92d13e234323 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:11.325676 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e4ffcd4-91a0-427c-a84d-92d13e234323 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:11.363082 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5ff63e82-7249-4289-b0e4-24daa20be63e tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1036377d4d94bb3a929aee17ca5eeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808169451dd64aa1a6a656ed9abbe5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:11.374800 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5ff63e82-7249-4289-b0e4-24daa20be63e tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 200 len: 1314 microversion: 2.1 time: 0.378318 Sep 27 16:38:11.375478 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 70/135] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:10 2022] GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:11.578813 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4e4ffcd4-91a0-427c-a84d-92d13e234323 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:11.590530 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4e4ffcd4-91a0-427c-a84d-92d13e234323 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1516 microversion: 2.1 time: 0.287530 Sep 27 16:38:11.594858 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 66/136] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:11 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1516 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:38:11.612359 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1159aefe-c5e1-4ac3-b1b0-40b3ae7b819d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:11.616165 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1159aefe-c5e1-4ac3-b1b0-40b3ae7b819d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:11.625140 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1159aefe-c5e1-4ac3-b1b0-40b3ae7b819d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:11.626184 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1159aefe-c5e1-4ac3-b1b0-40b3ae7b819d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:11.626821 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1159aefe-c5e1-4ac3-b1b0-40b3ae7b819d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:11.627734 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1159aefe-c5e1-4ac3-b1b0-40b3ae7b819d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:11.628348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1159aefe-c5e1-4ac3-b1b0-40b3ae7b819d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:11.628927 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1159aefe-c5e1-4ac3-b1b0-40b3ae7b819d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:11.661669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-1159aefe-c5e1-4ac3-b1b0-40b3ae7b819d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lazy-loading 'flavor' on Instance uuid 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:38:12.219559 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1159aefe-c5e1-4ac3-b1b0-40b3ae7b819d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "POST /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666/action" status: 200 len: 32 microversion: 2.1 time: 0.610717 Sep 27 16:38:12.220814 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 71/137] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Sep 27 16:38:11 2022] POST /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666/action => generated 32 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 16:38:12.233607 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1838c912-72ec-4ede-9125-1b85c06c8f49 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:12.234243 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1838c912-72ec-4ede-9125-1b85c06c8f49 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:12.246059 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1838c912-72ec-4ede-9125-1b85c06c8f49 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:12.246554 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1838c912-72ec-4ede-9125-1b85c06c8f49 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:12.247052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1838c912-72ec-4ede-9125-1b85c06c8f49 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:12.247768 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1838c912-72ec-4ede-9125-1b85c06c8f49 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:12.248247 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1838c912-72ec-4ede-9125-1b85c06c8f49 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:12.255209 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1838c912-72ec-4ede-9125-1b85c06c8f49 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:12.289251 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2aa7b136-e1d6-4998-93dc-784fd6ac8863 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2052037327", "imageRef": "6908a343-46fa-4801-bfb5-7ad92ac26956", "flavorRef": "452", "networks": [{"uuid": "842f602d-43b0-47fc-8317-0141848ffd1d"}]}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:12.359639 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-2aa7b136-e1d6-4998-93dc-784fd6ac8863 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] validate_networks() for [('842f602d-43b0-47fc-8317-0141848ffd1d', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 16:38:12.735808 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1838c912-72ec-4ede-9125-1b85c06c8f49 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:12.748240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1838c912-72ec-4ede-9125-1b85c06c8f49 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.521816 Sep 27 16:38:12.750661 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 67/138] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:12 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:12.770253 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-573fc5df-58a5-4167-b1cd-8a7e72d059f1 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:12.775025 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-573fc5df-58a5-4167-b1cd-8a7e72d059f1 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:12.786537 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-573fc5df-58a5-4167-b1cd-8a7e72d059f1 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:12.799255 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-573fc5df-58a5-4167-b1cd-8a7e72d059f1 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:12.800095 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-573fc5df-58a5-4167-b1cd-8a7e72d059f1 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:12.801381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-573fc5df-58a5-4167-b1cd-8a7e72d059f1 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:12.801997 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-573fc5df-58a5-4167-b1cd-8a7e72d059f1 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:12.808092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-573fc5df-58a5-4167-b1cd-8a7e72d059f1 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:13.263970 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-573fc5df-58a5-4167-b1cd-8a7e72d059f1 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1036377d4d94bb3a929aee17ca5eeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808169451dd64aa1a6a656ed9abbe5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:13.272864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-573fc5df-58a5-4167-b1cd-8a7e72d059f1 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 200 len: 1314 microversion: 2.1 time: 0.521114 Sep 27 16:38:13.278356 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 68/139] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:12 2022] GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:13.321858 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-2aa7b136-e1d6-4998-93dc-784fd6ac8863 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 16:38:13.322420 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-2aa7b136-e1d6-4998-93dc-784fd6ac8863 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 16:38:13.322739 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-2aa7b136-e1d6-4998-93dc-784fd6ac8863 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 16:38:13.324594 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-2aa7b136-e1d6-4998-93dc-784fd6ac8863 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 16:38:13.325016 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-2aa7b136-e1d6-4998-93dc-784fd6ac8863 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 16:38:13.335795 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2aa7b136-e1d6-4998-93dc-784fd6ac8863 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:13.336466 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2aa7b136-e1d6-4998-93dc-784fd6ac8863 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:13.337860 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2aa7b136-e1d6-4998-93dc-784fd6ac8863 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:13.338313 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2aa7b136-e1d6-4998-93dc-784fd6ac8863 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:13.339186 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2aa7b136-e1d6-4998-93dc-784fd6ac8863 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:13.340104 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2aa7b136-e1d6-4998-93dc-784fd6ac8863 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:13.357670 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-2aa7b136-e1d6-4998-93dc-784fd6ac8863 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Getting quotas for project 54a4b85dba3b48b68e25c190b98b6197. Resources: {'instances', 'ram', 'cores'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:38:13.361839 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-2aa7b136-e1d6-4998-93dc-784fd6ac8863 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Getting quotas for user f7e32dbc314d4953b3e3c21cbb481367 and project 54a4b85dba3b48b68e25c190b98b6197. Resources: {'instances', 'ram', 'cores'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:38:13.373317 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2aa7b136-e1d6-4998-93dc-784fd6ac8863 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 16:38:13.375836 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2aa7b136-e1d6-4998-93dc-784fd6ac8863 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6908a343-46fa-4801-bfb5-7ad92ac26956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 16:38:13.411932 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-102677a6-5cab-4211-a04a-19fb985185e4 req-09ad19fe-b51f-428a-8ec1-99980ed96d65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26a5e8aa-3521-49a9-9fda-15333f231793", "tag": "6c365b2d-c90e-47bb-a27e-019faaa15085"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:13.434881 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-102677a6-5cab-4211-a04a-19fb985185e4 req-09ad19fe-b51f-428a-8ec1-99980ed96d65 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:13.435593 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-102677a6-5cab-4211-a04a-19fb985185e4 req-09ad19fe-b51f-428a-8ec1-99980ed96d65 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:13.436367 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-102677a6-5cab-4211-a04a-19fb985185e4 req-09ad19fe-b51f-428a-8ec1-99980ed96d65 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:13.449024 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-102677a6-5cab-4211-a04a-19fb985185e4 req-09ad19fe-b51f-428a-8ec1-99980ed96d65 service nova] Creating event network-changed:6c365b2d-c90e-47bb-a27e-019faaa15085 for instance 26a5e8aa-3521-49a9-9fda-15333f231793 on hv-cinder-85506 Sep 27 16:38:13.454283 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-102677a6-5cab-4211-a04a-19fb985185e4 req-09ad19fe-b51f-428a-8ec1-99980ed96d65 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046263 Sep 27 16:38:13.455054 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 69/140] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:38:13.582615 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2aa7b136-e1d6-4998-93dc-784fd6ac8863 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.298143 Sep 27 16:38:13.595693 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-28ad00cf-bbed-4c6c-9a54-333fa827a54f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:13.596392 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-28ad00cf-bbed-4c6c-9a54-333fa827a54f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:13.601813 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 72/141] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Sep 27 16:38:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 16:38:13.702826 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-28ad00cf-bbed-4c6c-9a54-333fa827a54f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:13.707316 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-28ad00cf-bbed-4c6c-9a54-333fa827a54f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5" status: 200 len: 1214 microversion: 2.1 time: 0.116279 Sep 27 16:38:13.707896 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 70/142] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:13 2022] GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 => generated 1214 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:38:13.774113 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-192ce4ae-efdd-48f5-82bd-616ac97d6a87 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:13.774948 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-192ce4ae-efdd-48f5-82bd-616ac97d6a87 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:13.793996 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-192ce4ae-efdd-48f5-82bd-616ac97d6a87 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:13.799879 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-192ce4ae-efdd-48f5-82bd-616ac97d6a87 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:13.799879 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-192ce4ae-efdd-48f5-82bd-616ac97d6a87 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:13.799879 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-192ce4ae-efdd-48f5-82bd-616ac97d6a87 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:13.799879 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-192ce4ae-efdd-48f5-82bd-616ac97d6a87 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:13.800679 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-192ce4ae-efdd-48f5-82bd-616ac97d6a87 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:14.054483 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-192ce4ae-efdd-48f5-82bd-616ac97d6a87 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:14.066369 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-192ce4ae-efdd-48f5-82bd-616ac97d6a87 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.296733 Sep 27 16:38:14.067944 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 73/143] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:13 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:14.305171 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1a999265-c29d-4761-b92a-fb01b2cade53 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:14.306884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1a999265-c29d-4761-b92a-fb01b2cade53 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:14.335547 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a999265-c29d-4761-b92a-fb01b2cade53 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:14.336381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a999265-c29d-4761-b92a-fb01b2cade53 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:14.337033 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a999265-c29d-4761-b92a-fb01b2cade53 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:14.338131 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a999265-c29d-4761-b92a-fb01b2cade53 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:14.340275 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a999265-c29d-4761-b92a-fb01b2cade53 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:14.340920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a999265-c29d-4761-b92a-fb01b2cade53 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:14.515389 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1a999265-c29d-4761-b92a-fb01b2cade53 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1036377d4d94bb3a929aee17ca5eeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808169451dd64aa1a6a656ed9abbe5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:14.526968 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1a999265-c29d-4761-b92a-fb01b2cade53 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 200 len: 1314 microversion: 2.1 time: 0.233980 Sep 27 16:38:14.527556 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 71/144] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:14 2022] GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:14.732051 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9aac9b33-616f-4a58-994a-5774105174d2 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:14.733057 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9aac9b33-616f-4a58-994a-5774105174d2 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:14.792141 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9aac9b33-616f-4a58-994a-5774105174d2 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:14.805293 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9aac9b33-616f-4a58-994a-5774105174d2 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5" status: 200 len: 1214 microversion: 2.1 time: 0.075371 Sep 27 16:38:14.805293 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 74/145] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:14 2022] GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:15.089611 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-91e32cad-08cf-47cc-9a79-bce1dde26088 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:15.090232 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-91e32cad-08cf-47cc-9a79-bce1dde26088 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:15.097682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91e32cad-08cf-47cc-9a79-bce1dde26088 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:15.098037 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91e32cad-08cf-47cc-9a79-bce1dde26088 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:15.098823 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91e32cad-08cf-47cc-9a79-bce1dde26088 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:15.100208 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91e32cad-08cf-47cc-9a79-bce1dde26088 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:15.100856 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91e32cad-08cf-47cc-9a79-bce1dde26088 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:15.101292 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91e32cad-08cf-47cc-9a79-bce1dde26088 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:15.259196 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-91e32cad-08cf-47cc-9a79-bce1dde26088 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:15.263383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:15.268811 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-91e32cad-08cf-47cc-9a79-bce1dde26088 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.183152 Sep 27 16:38:15.269640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 72/146] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:15 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:15.552983 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e3c07b40-8566-41b9-afb7-3ba44ddc1371 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:15.553709 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e3c07b40-8566-41b9-afb7-3ba44ddc1371 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:15.558376 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:15.562488 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e3c07b40-8566-41b9-afb7-3ba44ddc1371 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:15.563203 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e3c07b40-8566-41b9-afb7-3ba44ddc1371 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:15.563820 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e3c07b40-8566-41b9-afb7-3ba44ddc1371 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:15.564682 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e3c07b40-8566-41b9-afb7-3ba44ddc1371 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:15.565296 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e3c07b40-8566-41b9-afb7-3ba44ddc1371 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:15.565876 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e3c07b40-8566-41b9-afb7-3ba44ddc1371 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:15.571222 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:15.765269 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e3c07b40-8566-41b9-afb7-3ba44ddc1371 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1036377d4d94bb3a929aee17ca5eeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808169451dd64aa1a6a656ed9abbe5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:15.778058 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e3c07b40-8566-41b9-afb7-3ba44ddc1371 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 200 len: 1314 microversion: 2.1 time: 0.226749 Sep 27 16:38:15.778913 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 75/147] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:15 2022] GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:15.828507 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f771d196-dbf8-4ac3-a242-69b801e47b00 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:15.829129 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f771d196-dbf8-4ac3-a242-69b801e47b00 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:15.836581 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f771d196-dbf8-4ac3-a242-69b801e47b00 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:15.837088 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f771d196-dbf8-4ac3-a242-69b801e47b00 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:15.842741 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f771d196-dbf8-4ac3-a242-69b801e47b00 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:15.842741 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f771d196-dbf8-4ac3-a242-69b801e47b00 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:15.842741 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f771d196-dbf8-4ac3-a242-69b801e47b00 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:15.842741 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f771d196-dbf8-4ac3-a242-69b801e47b00 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:15.912782 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f771d196-dbf8-4ac3-a242-69b801e47b00 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:15.923184 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f771d196-dbf8-4ac3-a242-69b801e47b00 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5" status: 200 len: 1218 microversion: 2.1 time: 0.098862 Sep 27 16:38:15.923991 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 73/148] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:15 2022] GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:16.311119 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4ce28599-4d44-4b0d-9319-0e3754868586 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:16.311119 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4ce28599-4d44-4b0d-9319-0e3754868586 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:16.320528 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ce28599-4d44-4b0d-9319-0e3754868586 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:16.321030 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ce28599-4d44-4b0d-9319-0e3754868586 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:16.328378 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ce28599-4d44-4b0d-9319-0e3754868586 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:16.329599 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ce28599-4d44-4b0d-9319-0e3754868586 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:16.330236 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ce28599-4d44-4b0d-9319-0e3754868586 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:16.330912 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ce28599-4d44-4b0d-9319-0e3754868586 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:16.491350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4ce28599-4d44-4b0d-9319-0e3754868586 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:16.500314 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4ce28599-4d44-4b0d-9319-0e3754868586 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.208506 Sep 27 16:38:16.514038 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 76/149] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:16 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:16.801227 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4198c2a4-de02-4e1f-bcc7-d9feb944320c tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:16.802126 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4198c2a4-de02-4e1f-bcc7-d9feb944320c tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:16.809526 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4198c2a4-de02-4e1f-bcc7-d9feb944320c tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:16.810029 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4198c2a4-de02-4e1f-bcc7-d9feb944320c tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:16.810480 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4198c2a4-de02-4e1f-bcc7-d9feb944320c tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:16.811219 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4198c2a4-de02-4e1f-bcc7-d9feb944320c tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:16.811687 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4198c2a4-de02-4e1f-bcc7-d9feb944320c tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:16.812115 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4198c2a4-de02-4e1f-bcc7-d9feb944320c tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:16.947632 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-186cdb29-fbdf-4919-a570-9e4dc67401ae tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:16.949722 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-186cdb29-fbdf-4919-a570-9e4dc67401ae tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:16.952402 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4198c2a4-de02-4e1f-bcc7-d9feb944320c tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1036377d4d94bb3a929aee17ca5eeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808169451dd64aa1a6a656ed9abbe5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:16.956430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-186cdb29-fbdf-4919-a570-9e4dc67401ae tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:16.957172 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-186cdb29-fbdf-4919-a570-9e4dc67401ae tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:16.957726 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-186cdb29-fbdf-4919-a570-9e4dc67401ae tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:16.958655 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-186cdb29-fbdf-4919-a570-9e4dc67401ae tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:16.959330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-186cdb29-fbdf-4919-a570-9e4dc67401ae tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:16.959780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-186cdb29-fbdf-4919-a570-9e4dc67401ae tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:16.965776 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4198c2a4-de02-4e1f-bcc7-d9feb944320c tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 200 len: 1314 microversion: 2.1 time: 0.163973 Sep 27 16:38:16.965776 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 74/150] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:16 2022] GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:17.021528 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-186cdb29-fbdf-4919-a570-9e4dc67401ae tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:17.030380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-186cdb29-fbdf-4919-a570-9e4dc67401ae tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5" status: 200 len: 1266 microversion: 2.1 time: 0.086614 Sep 27 16:38:17.030975 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 77/151] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:16 2022] GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:38:17.524057 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-10faa3dc-2bd4-4b7b-a658-08bf7b72efb7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:17.524864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-10faa3dc-2bd4-4b7b-a658-08bf7b72efb7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:17.532154 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10faa3dc-2bd4-4b7b-a658-08bf7b72efb7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:17.532715 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10faa3dc-2bd4-4b7b-a658-08bf7b72efb7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:17.533219 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10faa3dc-2bd4-4b7b-a658-08bf7b72efb7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:17.533975 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10faa3dc-2bd4-4b7b-a658-08bf7b72efb7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:17.534550 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10faa3dc-2bd4-4b7b-a658-08bf7b72efb7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:17.535028 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10faa3dc-2bd4-4b7b-a658-08bf7b72efb7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:17.685016 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-10faa3dc-2bd4-4b7b-a658-08bf7b72efb7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:17.693011 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-10faa3dc-2bd4-4b7b-a658-08bf7b72efb7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.172947 Sep 27 16:38:17.694442 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 75/152] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:17 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:17.984681 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-14862c88-9c25-4eaf-83a0-4ebd89738415 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:17.985388 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-14862c88-9c25-4eaf-83a0-4ebd89738415 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:17.993441 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-14862c88-9c25-4eaf-83a0-4ebd89738415 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:17.993914 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-14862c88-9c25-4eaf-83a0-4ebd89738415 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:17.994350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-14862c88-9c25-4eaf-83a0-4ebd89738415 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:17.995984 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-14862c88-9c25-4eaf-83a0-4ebd89738415 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:17.996657 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-14862c88-9c25-4eaf-83a0-4ebd89738415 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:17.997269 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-14862c88-9c25-4eaf-83a0-4ebd89738415 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:18.056137 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e9eafbc4-c10f-463b-8e65-2f12ee4b5019 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:18.058054 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e9eafbc4-c10f-463b-8e65-2f12ee4b5019 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:18.073451 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9eafbc4-c10f-463b-8e65-2f12ee4b5019 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:18.074127 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9eafbc4-c10f-463b-8e65-2f12ee4b5019 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:18.075572 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9eafbc4-c10f-463b-8e65-2f12ee4b5019 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:18.076477 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9eafbc4-c10f-463b-8e65-2f12ee4b5019 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:18.077093 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9eafbc4-c10f-463b-8e65-2f12ee4b5019 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:18.077815 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9eafbc4-c10f-463b-8e65-2f12ee4b5019 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:18.219057 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e9eafbc4-c10f-463b-8e65-2f12ee4b5019 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:18.227459 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e9eafbc4-c10f-463b-8e65-2f12ee4b5019 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5" status: 200 len: 1266 microversion: 2.1 time: 0.176067 Sep 27 16:38:18.228057 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 76/153] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:18 2022] GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:38:18.251961 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-14862c88-9c25-4eaf-83a0-4ebd89738415 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1036377d4d94bb3a929aee17ca5eeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808169451dd64aa1a6a656ed9abbe5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:18.263053 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-14862c88-9c25-4eaf-83a0-4ebd89738415 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 200 len: 1314 microversion: 2.1 time: 0.282124 Sep 27 16:38:18.264356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 78/154] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:17 2022] GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:18.392776 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0ea8d675-6bd6-452e-9c27-33dcd06f47e5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:18.393500 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0ea8d675-6bd6-452e-9c27-33dcd06f47e5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:18.400126 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ea8d675-6bd6-452e-9c27-33dcd06f47e5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:18.400715 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ea8d675-6bd6-452e-9c27-33dcd06f47e5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:18.401803 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ea8d675-6bd6-452e-9c27-33dcd06f47e5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:18.402625 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ea8d675-6bd6-452e-9c27-33dcd06f47e5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:18.403183 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ea8d675-6bd6-452e-9c27-33dcd06f47e5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:18.403677 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ea8d675-6bd6-452e-9c27-33dcd06f47e5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:18.429553 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0ea8d675-6bd6-452e-9c27-33dcd06f47e5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9/ips" status: 200 len: 152 microversion: 2.20 time: 0.041674 Sep 27 16:38:18.430743 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 77/155] 10.222.0.64 () {60 vars in 1289 bytes} [Tue Sep 27 16:38:18 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 16:38:18.717516 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-aef08244-5174-4201-947b-8113975929e6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:18.718391 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-aef08244-5174-4201-947b-8113975929e6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:18.727224 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aef08244-5174-4201-947b-8113975929e6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:18.727713 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aef08244-5174-4201-947b-8113975929e6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:18.728172 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aef08244-5174-4201-947b-8113975929e6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:18.729115 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aef08244-5174-4201-947b-8113975929e6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:18.729767 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aef08244-5174-4201-947b-8113975929e6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:18.730364 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aef08244-5174-4201-947b-8113975929e6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:18.909963 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-aef08244-5174-4201-947b-8113975929e6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:18.923152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-aef08244-5174-4201-947b-8113975929e6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.209928 Sep 27 16:38:18.923816 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 79/156] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:18 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:19.254730 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-11922f04-b2f3-4829-b1fb-87a872873bd0 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:19.255502 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-11922f04-b2f3-4829-b1fb-87a872873bd0 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:19.267548 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11922f04-b2f3-4829-b1fb-87a872873bd0 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:19.267548 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11922f04-b2f3-4829-b1fb-87a872873bd0 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:19.267548 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11922f04-b2f3-4829-b1fb-87a872873bd0 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:19.267548 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11922f04-b2f3-4829-b1fb-87a872873bd0 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:19.267906 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11922f04-b2f3-4829-b1fb-87a872873bd0 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:19.269733 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11922f04-b2f3-4829-b1fb-87a872873bd0 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:19.293530 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0f1a66db-c528-41c8-9474-d24e3aa43ad7 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:19.294905 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0f1a66db-c528-41c8-9474-d24e3aa43ad7 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:19.311848 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f1a66db-c528-41c8-9474-d24e3aa43ad7 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:19.314510 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f1a66db-c528-41c8-9474-d24e3aa43ad7 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:19.316488 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f1a66db-c528-41c8-9474-d24e3aa43ad7 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:19.317320 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f1a66db-c528-41c8-9474-d24e3aa43ad7 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:19.319348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f1a66db-c528-41c8-9474-d24e3aa43ad7 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:19.320039 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f1a66db-c528-41c8-9474-d24e3aa43ad7 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:19.399138 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-11922f04-b2f3-4829-b1fb-87a872873bd0 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:19.411090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-11922f04-b2f3-4829-b1fb-87a872873bd0 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5" status: 200 len: 1266 microversion: 2.1 time: 0.159958 Sep 27 16:38:19.411753 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 78/157] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:19 2022] GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:38:19.528419 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0f1a66db-c528-41c8-9474-d24e3aa43ad7 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1036377d4d94bb3a929aee17ca5eeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808169451dd64aa1a6a656ed9abbe5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:19.538106 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0f1a66db-c528-41c8-9474-d24e3aa43ad7 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 200 len: 1314 microversion: 2.1 time: 0.249053 Sep 27 16:38:19.539380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 80/158] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:19 2022] GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:19.596370 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7ea3b27d-5632-487d-9e03-db1653e14ed3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:19.597834 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7ea3b27d-5632-487d-9e03-db1653e14ed3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:19.604982 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7ea3b27d-5632-487d-9e03-db1653e14ed3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:19.605465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7ea3b27d-5632-487d-9e03-db1653e14ed3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:19.605939 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7ea3b27d-5632-487d-9e03-db1653e14ed3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:19.606630 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7ea3b27d-5632-487d-9e03-db1653e14ed3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:19.607128 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7ea3b27d-5632-487d-9e03-db1653e14ed3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:19.607554 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7ea3b27d-5632-487d-9e03-db1653e14ed3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:19.633248 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7ea3b27d-5632-487d-9e03-db1653e14ed3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226/ips" status: 200 len: 150 microversion: 2.1 time: 0.045445 Sep 27 16:38:19.633821 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 79/159] 10.222.0.64 () {58 vars in 1248 bytes} [Tue Sep 27 16:38:19 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:38:19.956246 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3a68a178-c26b-4216-9538-8364bb6efa2c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:19.957010 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3a68a178-c26b-4216-9538-8364bb6efa2c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:19.963105 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a68a178-c26b-4216-9538-8364bb6efa2c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:19.963904 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a68a178-c26b-4216-9538-8364bb6efa2c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:19.964564 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a68a178-c26b-4216-9538-8364bb6efa2c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:19.965507 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a68a178-c26b-4216-9538-8364bb6efa2c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:19.966033 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a68a178-c26b-4216-9538-8364bb6efa2c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:19.966525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a68a178-c26b-4216-9538-8364bb6efa2c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:20.197756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3a68a178-c26b-4216-9538-8364bb6efa2c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:20.211176 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3a68a178-c26b-4216-9538-8364bb6efa2c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.258797 Sep 27 16:38:20.212032 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 81/160] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:19 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:20.435909 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e7456c9a-3d09-4275-96db-686ee82d8e7b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:20.436524 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e7456c9a-3d09-4275-96db-686ee82d8e7b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:20.445062 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e7456c9a-3d09-4275-96db-686ee82d8e7b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:20.445822 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e7456c9a-3d09-4275-96db-686ee82d8e7b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:20.446406 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e7456c9a-3d09-4275-96db-686ee82d8e7b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:20.447298 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e7456c9a-3d09-4275-96db-686ee82d8e7b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:20.447787 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e7456c9a-3d09-4275-96db-686ee82d8e7b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:20.448221 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e7456c9a-3d09-4275-96db-686ee82d8e7b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:20.538018 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e7456c9a-3d09-4275-96db-686ee82d8e7b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:20.547153 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e7456c9a-3d09-4275-96db-686ee82d8e7b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5" status: 200 len: 1272 microversion: 2.1 time: 0.115762 Sep 27 16:38:20.547743 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 80/161] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:20 2022] GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 => generated 1272 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:20.572142 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2dc8d051-55fb-4c1d-9975-8268361e92e6 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:20.573136 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2dc8d051-55fb-4c1d-9975-8268361e92e6 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:20.580998 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2dc8d051-55fb-4c1d-9975-8268361e92e6 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:20.581775 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2dc8d051-55fb-4c1d-9975-8268361e92e6 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:20.582209 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2dc8d051-55fb-4c1d-9975-8268361e92e6 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:20.582992 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2dc8d051-55fb-4c1d-9975-8268361e92e6 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:20.584261 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2dc8d051-55fb-4c1d-9975-8268361e92e6 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:20.584918 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2dc8d051-55fb-4c1d-9975-8268361e92e6 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:20.903849 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2dc8d051-55fb-4c1d-9975-8268361e92e6 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1036377d4d94bb3a929aee17ca5eeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808169451dd64aa1a6a656ed9abbe5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:20.912125 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2dc8d051-55fb-4c1d-9975-8268361e92e6 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 200 len: 1314 microversion: 2.1 time: 0.343744 Sep 27 16:38:20.912732 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 82/162] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:20 2022] GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:21.236191 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-429962d2-d08e-4a50-a259-09428f766582 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:21.236805 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-429962d2-d08e-4a50-a259-09428f766582 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:21.243112 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-429962d2-d08e-4a50-a259-09428f766582 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:21.243894 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-429962d2-d08e-4a50-a259-09428f766582 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:21.246879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-429962d2-d08e-4a50-a259-09428f766582 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:21.246879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-429962d2-d08e-4a50-a259-09428f766582 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:21.246879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-429962d2-d08e-4a50-a259-09428f766582 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:21.246879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-429962d2-d08e-4a50-a259-09428f766582 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:21.271252 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2761dca3-7a4c-4f32-9e0d-cd67ec804a43 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:21.276754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2761dca3-7a4c-4f32-9e0d-cd67ec804a43 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:21.279052 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2761dca3-7a4c-4f32-9e0d-cd67ec804a43 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:21.279562 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2761dca3-7a4c-4f32-9e0d-cd67ec804a43 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:21.279992 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2761dca3-7a4c-4f32-9e0d-cd67ec804a43 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:21.280787 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2761dca3-7a4c-4f32-9e0d-cd67ec804a43 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:21.281535 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2761dca3-7a4c-4f32-9e0d-cd67ec804a43 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:21.282003 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2761dca3-7a4c-4f32-9e0d-cd67ec804a43 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:21.315392 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-2761dca3-7a4c-4f32-9e0d-cd67ec804a43 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lazy-loading 'flavor' on Instance uuid f84acf37-9445-48cd-a921-12a7a3c301d9 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:38:21.589308 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-429962d2-d08e-4a50-a259-09428f766582 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:21.603437 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-429962d2-d08e-4a50-a259-09428f766582 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.368742 Sep 27 16:38:21.604686 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 81/163] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:21 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:21.614966 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0e7aeb52-eb63-42d8-89c3-f9afdc229e1c tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:21.614966 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0e7aeb52-eb63-42d8-89c3-f9afdc229e1c tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:21.630724 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=75 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:21.635015 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e7aeb52-eb63-42d8-89c3-f9afdc229e1c tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:21.638331 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e7aeb52-eb63-42d8-89c3-f9afdc229e1c tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:21.639226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e7aeb52-eb63-42d8-89c3-f9afdc229e1c tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:21.642718 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e7aeb52-eb63-42d8-89c3-f9afdc229e1c tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:21.643592 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e7aeb52-eb63-42d8-89c3-f9afdc229e1c tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:21.644331 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e7aeb52-eb63-42d8-89c3-f9afdc229e1c tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:22.079487 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2761dca3-7a4c-4f32-9e0d-cd67ec804a43 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "POST /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9/action" status: 202 len: 0 microversion: 2.20 time: 0.813139 Sep 27 16:38:22.082680 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 83/164] 10.222.0.64 () {62 vars in 1319 bytes} [Tue Sep 27 16:38:21 2022] POST /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9/action => generated 0 bytes in 819 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 16:38:22.092937 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-43f56b41-8476-4a38-ad62-ec504f647bab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6711ce7-ec46-495c-a651-72c6a6b1964e"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:22.095995 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-43f56b41-8476-4a38-ad62-ec504f647bab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:22.105337 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43f56b41-8476-4a38-ad62-ec504f647bab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:22.105898 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43f56b41-8476-4a38-ad62-ec504f647bab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:22.106404 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43f56b41-8476-4a38-ad62-ec504f647bab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:22.107338 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43f56b41-8476-4a38-ad62-ec504f647bab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:22.107872 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43f56b41-8476-4a38-ad62-ec504f647bab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:22.108407 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43f56b41-8476-4a38-ad62-ec504f647bab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:22.321102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0e7aeb52-eb63-42d8-89c3-f9afdc229e1c tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:22.335705 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0e7aeb52-eb63-42d8-89c3-f9afdc229e1c tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5" status: 200 len: 1314 microversion: 2.1 time: 0.727894 Sep 27 16:38:22.336949 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 82/165] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:21 2022] GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 => generated 1314 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:22.343196 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ec37ce7f-9e42-4292-9dcb-45956b0d0dab tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:22.348828 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ec37ce7f-9e42-4292-9dcb-45956b0d0dab tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:22.365328 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec37ce7f-9e42-4292-9dcb-45956b0d0dab tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:22.367572 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec37ce7f-9e42-4292-9dcb-45956b0d0dab tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:22.368619 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec37ce7f-9e42-4292-9dcb-45956b0d0dab tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:22.370816 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec37ce7f-9e42-4292-9dcb-45956b0d0dab tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:22.373574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec37ce7f-9e42-4292-9dcb-45956b0d0dab tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:22.374352 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ec37ce7f-9e42-4292-9dcb-45956b0d0dab tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:22.624735 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ec37ce7f-9e42-4292-9dcb-45956b0d0dab tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1036377d4d94bb3a929aee17ca5eeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808169451dd64aa1a6a656ed9abbe5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:22.633891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ec37ce7f-9e42-4292-9dcb-45956b0d0dab tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 200 len: 1314 microversion: 2.1 time: 0.294752 Sep 27 16:38:22.635771 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 83/166] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:22 2022] GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:22.644267 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ee774319-1e1e-46b5-8f70-1d8f7a7a5b51 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:22.650505 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ee774319-1e1e-46b5-8f70-1d8f7a7a5b51 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:22.664021 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee774319-1e1e-46b5-8f70-1d8f7a7a5b51 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:22.664021 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee774319-1e1e-46b5-8f70-1d8f7a7a5b51 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:22.664021 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee774319-1e1e-46b5-8f70-1d8f7a7a5b51 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:22.664021 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee774319-1e1e-46b5-8f70-1d8f7a7a5b51 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:22.664379 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee774319-1e1e-46b5-8f70-1d8f7a7a5b51 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:22.664379 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee774319-1e1e-46b5-8f70-1d8f7a7a5b51 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:22.928224 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ee774319-1e1e-46b5-8f70-1d8f7a7a5b51 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:22.956027 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ee774319-1e1e-46b5-8f70-1d8f7a7a5b51 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:22.958798 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ee774319-1e1e-46b5-8f70-1d8f7a7a5b51 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:22.961350 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ee774319-1e1e-46b5-8f70-1d8f7a7a5b51 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1723 microversion: 2.20 time: 0.324175 Sep 27 16:38:22.961928 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 84/167] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:22 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:38:22.992188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0e8c8f66-f338-4082-9c3c-741351efc6f7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:22.993870 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0e8c8f66-f338-4082-9c3c-741351efc6f7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:23.013030 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e8c8f66-f338-4082-9c3c-741351efc6f7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:23.013549 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e8c8f66-f338-4082-9c3c-741351efc6f7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:23.014000 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e8c8f66-f338-4082-9c3c-741351efc6f7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:23.014731 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e8c8f66-f338-4082-9c3c-741351efc6f7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:23.015222 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e8c8f66-f338-4082-9c3c-741351efc6f7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:23.017161 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e8c8f66-f338-4082-9c3c-741351efc6f7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:23.192903 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-43f56b41-8476-4a38-ad62-ec504f647bab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "POST /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.107048 Sep 27 16:38:23.193686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 84/168] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Sep 27 16:38:22 2022] POST /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226/os-volume_attachments => generated 194 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:38:23.229159 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-19f1ecae-5557-42e9-bd8d-c00d21b81e83 req-c37fad40-e3f0-400c-94ac-ede415315f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26a5e8aa-3521-49a9-9fda-15333f231793", "name": "network-vif-plugged", "status": "completed", "tag": "6c365b2d-c90e-47bb-a27e-019faaa15085"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:23.300060 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-19f1ecae-5557-42e9-bd8d-c00d21b81e83 req-c37fad40-e3f0-400c-94ac-ede415315f9d service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:23.302531 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-19f1ecae-5557-42e9-bd8d-c00d21b81e83 req-c37fad40-e3f0-400c-94ac-ede415315f9d service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:23.305065 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-19f1ecae-5557-42e9-bd8d-c00d21b81e83 req-c37fad40-e3f0-400c-94ac-ede415315f9d service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:23.310919 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0e8c8f66-f338-4082-9c3c-741351efc6f7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:23.323280 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0e8c8f66-f338-4082-9c3c-741351efc6f7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.348334 Sep 27 16:38:23.324307 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 85/169] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:22 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:23.357093 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=4 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:23.372101 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-19f1ecae-5557-42e9-bd8d-c00d21b81e83 req-c37fad40-e3f0-400c-94ac-ede415315f9d service nova] Creating event network-vif-plugged:6c365b2d-c90e-47bb-a27e-019faaa15085 for instance 26a5e8aa-3521-49a9-9fda-15333f231793 on hv-cinder-85506 Sep 27 16:38:23.378673 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e16b1c62-8073-49d6-b7ed-3e1b32596035 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:23.382051 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e16b1c62-8073-49d6-b7ed-3e1b32596035 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:23.401729 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e16b1c62-8073-49d6-b7ed-3e1b32596035 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:23.403946 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e16b1c62-8073-49d6-b7ed-3e1b32596035 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:23.405064 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e16b1c62-8073-49d6-b7ed-3e1b32596035 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:23.405821 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e16b1c62-8073-49d6-b7ed-3e1b32596035 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:23.408255 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e16b1c62-8073-49d6-b7ed-3e1b32596035 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:23.408611 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-19f1ecae-5557-42e9-bd8d-c00d21b81e83 req-c37fad40-e3f0-400c-94ac-ede415315f9d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207954 Sep 27 16:38:23.408725 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e16b1c62-8073-49d6-b7ed-3e1b32596035 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:23.409223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 85/170] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:38:23.660781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7f77e5a8-4495-4d25-86b9-dc9350d0a30c tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:23.661486 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7f77e5a8-4495-4d25-86b9-dc9350d0a30c tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:23.678165 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f77e5a8-4495-4d25-86b9-dc9350d0a30c tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:23.679668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f77e5a8-4495-4d25-86b9-dc9350d0a30c tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:23.680124 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f77e5a8-4495-4d25-86b9-dc9350d0a30c tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:23.680864 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f77e5a8-4495-4d25-86b9-dc9350d0a30c tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:23.681332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f77e5a8-4495-4d25-86b9-dc9350d0a30c tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:23.681762 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f77e5a8-4495-4d25-86b9-dc9350d0a30c tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:23.706235 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=6 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:24.018536 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e16b1c62-8073-49d6-b7ed-3e1b32596035 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:24.031664 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7f77e5a8-4495-4d25-86b9-dc9350d0a30c tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1036377d4d94bb3a929aee17ca5eeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808169451dd64aa1a6a656ed9abbe5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:24.039320 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e16b1c62-8073-49d6-b7ed-3e1b32596035 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5" status: 200 len: 1314 microversion: 2.1 time: 0.681888 Sep 27 16:38:24.039922 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 86/171] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:23 2022] GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 => generated 1314 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:24.048057 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7f77e5a8-4495-4d25-86b9-dc9350d0a30c tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 200 len: 1314 microversion: 2.1 time: 0.392349 Sep 27 16:38:24.051542 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b4dcf735-cf58-4c18-acab-a4184d8812ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:24.051663 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 86/172] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:23 2022] GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:24.051754 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b4dcf735-cf58-4c18-acab-a4184d8812ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:24.071496 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4dcf735-cf58-4c18-acab-a4184d8812ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:24.072651 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4dcf735-cf58-4c18-acab-a4184d8812ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:24.073558 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4dcf735-cf58-4c18-acab-a4184d8812ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:24.074644 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4dcf735-cf58-4c18-acab-a4184d8812ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:24.075362 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4dcf735-cf58-4c18-acab-a4184d8812ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:24.076010 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b4dcf735-cf58-4c18-acab-a4184d8812ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:24.204853 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-595cb288-842a-49e9-b506-4b140026ea85 req-91f4f03a-b627-4b97-8833-56d5cd8c3298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ad241be-370b-4cff-b34d-beea9d6842c5", "tag": "3f66f8e0-df9b-4202-aca4-c6652f4a9852"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:24.221304 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-595cb288-842a-49e9-b506-4b140026ea85 req-91f4f03a-b627-4b97-8833-56d5cd8c3298 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:24.222144 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-595cb288-842a-49e9-b506-4b140026ea85 req-91f4f03a-b627-4b97-8833-56d5cd8c3298 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:24.222816 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-595cb288-842a-49e9-b506-4b140026ea85 req-91f4f03a-b627-4b97-8833-56d5cd8c3298 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:24.248475 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-595cb288-842a-49e9-b506-4b140026ea85 req-91f4f03a-b627-4b97-8833-56d5cd8c3298 service nova] Creating event network-changed:3f66f8e0-df9b-4202-aca4-c6652f4a9852 for instance 6ad241be-370b-4cff-b34d-beea9d6842c5 on hv-cinder-85506 Sep 27 16:38:24.264344 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-595cb288-842a-49e9-b506-4b140026ea85 req-91f4f03a-b627-4b97-8833-56d5cd8c3298 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063089 Sep 27 16:38:24.265554 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 87/173] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:38:24.351673 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-99251c8d-fd31-4d1e-b14a-9c0c20b613c8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:24.352533 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-99251c8d-fd31-4d1e-b14a-9c0c20b613c8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:24.360614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99251c8d-fd31-4d1e-b14a-9c0c20b613c8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:24.361263 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99251c8d-fd31-4d1e-b14a-9c0c20b613c8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:24.361813 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99251c8d-fd31-4d1e-b14a-9c0c20b613c8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:24.362904 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99251c8d-fd31-4d1e-b14a-9c0c20b613c8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:24.363594 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99251c8d-fd31-4d1e-b14a-9c0c20b613c8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:24.364341 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99251c8d-fd31-4d1e-b14a-9c0c20b613c8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:24.435217 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b4dcf735-cf58-4c18-acab-a4184d8812ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:24.443699 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b4dcf735-cf58-4c18-acab-a4184d8812ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:24.451525 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b4dcf735-cf58-4c18-acab-a4184d8812ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:24.452820 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b4dcf735-cf58-4c18-acab-a4184d8812ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1723 microversion: 2.20 time: 0.409664 Sep 27 16:38:24.453386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 87/174] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:24 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1723 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:38:24.730335 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-99251c8d-fd31-4d1e-b14a-9c0c20b613c8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:24.749881 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-99251c8d-fd31-4d1e-b14a-9c0c20b613c8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.405666 Sep 27 16:38:24.752823 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 88/175] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:24 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:25.067307 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6743fd67-8078-445b-ace0-6652489f13b8 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:25.067920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6743fd67-8078-445b-ace0-6652489f13b8 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:25.077294 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6743fd67-8078-445b-ace0-6652489f13b8 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:25.077787 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6743fd67-8078-445b-ace0-6652489f13b8 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:25.078299 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6743fd67-8078-445b-ace0-6652489f13b8 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:25.078558 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-958d7785-8a70-4039-bd63-d2ae8894344b tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:25.079216 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-958d7785-8a70-4039-bd63-d2ae8894344b tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:25.079400 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6743fd67-8078-445b-ace0-6652489f13b8 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:25.080301 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6743fd67-8078-445b-ace0-6652489f13b8 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:25.080735 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6743fd67-8078-445b-ace0-6652489f13b8 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:25.089319 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=14 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:25.091104 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-958d7785-8a70-4039-bd63-d2ae8894344b tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:25.091608 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-958d7785-8a70-4039-bd63-d2ae8894344b tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:25.092028 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-958d7785-8a70-4039-bd63-d2ae8894344b tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:25.103289 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-958d7785-8a70-4039-bd63-d2ae8894344b tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:25.103289 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-958d7785-8a70-4039-bd63-d2ae8894344b tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:25.103289 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-958d7785-8a70-4039-bd63-d2ae8894344b tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:25.434244 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-958d7785-8a70-4039-bd63-d2ae8894344b tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1036377d4d94bb3a929aee17ca5eeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808169451dd64aa1a6a656ed9abbe5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:25.449814 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6743fd67-8078-445b-ace0-6652489f13b8 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:25.456699 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:25.461258 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6743fd67-8078-445b-ace0-6652489f13b8 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5" status: 200 len: 1314 microversion: 2.1 time: 0.398137 Sep 27 16:38:25.464893 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-958d7785-8a70-4039-bd63-d2ae8894344b tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 200 len: 1314 microversion: 2.1 time: 0.392943 Sep 27 16:38:25.465860 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 88/176] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:25 2022] GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:25.486555 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 89/177] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:25 2022] GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:38:25.490626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-17a8a722-eb5b-4604-995d-6a6969bd4b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:25.491277 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-17a8a722-eb5b-4604-995d-6a6969bd4b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:25.501020 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17a8a722-eb5b-4604-995d-6a6969bd4b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:25.501524 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17a8a722-eb5b-4604-995d-6a6969bd4b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:25.501965 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17a8a722-eb5b-4604-995d-6a6969bd4b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:25.503323 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17a8a722-eb5b-4604-995d-6a6969bd4b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:25.503783 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17a8a722-eb5b-4604-995d-6a6969bd4b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:25.504206 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17a8a722-eb5b-4604-995d-6a6969bd4b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:25.742101 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-17a8a722-eb5b-4604-995d-6a6969bd4b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:25.753652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-17a8a722-eb5b-4604-995d-6a6969bd4b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:25.759780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-17a8a722-eb5b-4604-995d-6a6969bd4b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:25.759780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-17a8a722-eb5b-4604-995d-6a6969bd4b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1723 microversion: 2.20 time: 0.278597 Sep 27 16:38:25.761098 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 89/178] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:25 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:38:25.773359 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b0baf49c-60fc-461d-98fc-2d67116d87ff tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:25.773963 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b0baf49c-60fc-461d-98fc-2d67116d87ff tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:25.780896 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0baf49c-60fc-461d-98fc-2d67116d87ff tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:25.785579 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0baf49c-60fc-461d-98fc-2d67116d87ff tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:25.785579 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0baf49c-60fc-461d-98fc-2d67116d87ff tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:25.785579 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0baf49c-60fc-461d-98fc-2d67116d87ff tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:25.785579 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0baf49c-60fc-461d-98fc-2d67116d87ff tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:25.785905 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0baf49c-60fc-461d-98fc-2d67116d87ff tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:25.928604 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b0baf49c-60fc-461d-98fc-2d67116d87ff tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:25.938970 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b0baf49c-60fc-461d-98fc-2d67116d87ff tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.169332 Sep 27 16:38:25.939708 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 90/179] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:25 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:26.493771 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-71c58c79-0495-494f-bd29-50a7394686e2 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:26.504076 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7569815b-fa72-4590-832b-80047062721c tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:26.504076 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7569815b-fa72-4590-832b-80047062721c tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:26.504602 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-71c58c79-0495-494f-bd29-50a7394686e2 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:26.504602 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71c58c79-0495-494f-bd29-50a7394686e2 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:26.504602 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71c58c79-0495-494f-bd29-50a7394686e2 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:26.504831 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7569815b-fa72-4590-832b-80047062721c tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:26.504905 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71c58c79-0495-494f-bd29-50a7394686e2 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:26.504976 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7569815b-fa72-4590-832b-80047062721c tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:26.505074 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71c58c79-0495-494f-bd29-50a7394686e2 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:26.505146 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7569815b-fa72-4590-832b-80047062721c tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:26.505224 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71c58c79-0495-494f-bd29-50a7394686e2 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:26.505294 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7569815b-fa72-4590-832b-80047062721c tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:26.505362 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71c58c79-0495-494f-bd29-50a7394686e2 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:26.505438 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7569815b-fa72-4590-832b-80047062721c tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:26.505438 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7569815b-fa72-4590-832b-80047062721c tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:26.507634 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:26.755843 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-71c58c79-0495-494f-bd29-50a7394686e2 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1036377d4d94bb3a929aee17ca5eeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808169451dd64aa1a6a656ed9abbe5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:26.761313 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7569815b-fa72-4590-832b-80047062721c tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:26.766150 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-71c58c79-0495-494f-bd29-50a7394686e2 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 200 len: 1463 microversion: 2.1 time: 0.276175 Sep 27 16:38:26.767125 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 90/180] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:26 2022] GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 1463 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:26.773820 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7569815b-fa72-4590-832b-80047062721c tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5" status: 200 len: 1314 microversion: 2.1 time: 0.283914 Sep 27 16:38:26.779069 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 91/181] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:26 2022] GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:26.786514 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-608f305b-3c8e-42a7-852d-345bdf6e5eff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:26.788191 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-608f305b-3c8e-42a7-852d-345bdf6e5eff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:26.803249 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-608f305b-3c8e-42a7-852d-345bdf6e5eff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:26.803914 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-608f305b-3c8e-42a7-852d-345bdf6e5eff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:26.804362 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-608f305b-3c8e-42a7-852d-345bdf6e5eff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:26.805180 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-608f305b-3c8e-42a7-852d-345bdf6e5eff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:26.805642 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-608f305b-3c8e-42a7-852d-345bdf6e5eff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:26.806150 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-608f305b-3c8e-42a7-852d-345bdf6e5eff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:26.825139 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-effda780-d169-4c62-a858-d2866d9f0b4f tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:26.825643 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-effda780-d169-4c62-a858-d2866d9f0b4f tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:26.832015 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-effda780-d169-4c62-a858-d2866d9f0b4f tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:26.832500 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-effda780-d169-4c62-a858-d2866d9f0b4f tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:26.832919 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-effda780-d169-4c62-a858-d2866d9f0b4f tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:26.833764 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-effda780-d169-4c62-a858-d2866d9f0b4f tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:26.834387 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-effda780-d169-4c62-a858-d2866d9f0b4f tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:26.835372 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-effda780-d169-4c62-a858-d2866d9f0b4f tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:26.864073 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-effda780-d169-4c62-a858-d2866d9f0b4f tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 16:38:26.972504 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-608f305b-3c8e-42a7-852d-345bdf6e5eff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:26.982158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-608f305b-3c8e-42a7-852d-345bdf6e5eff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:26.983653 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-608f305b-3c8e-42a7-852d-345bdf6e5eff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:26.985227 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-608f305b-3c8e-42a7-852d-345bdf6e5eff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1723 microversion: 2.20 time: 0.204739 Sep 27 16:38:26.985801 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 91/182] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:26 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:38:26.990664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e6c6604f-fff4-45c5-aa90-4dba6a79dc5a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:26.991490 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e6c6604f-fff4-45c5-aa90-4dba6a79dc5a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:27.003740 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6c6604f-fff4-45c5-aa90-4dba6a79dc5a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:27.003740 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6c6604f-fff4-45c5-aa90-4dba6a79dc5a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:27.003740 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6c6604f-fff4-45c5-aa90-4dba6a79dc5a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:27.003740 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6c6604f-fff4-45c5-aa90-4dba6a79dc5a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:27.004045 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6c6604f-fff4-45c5-aa90-4dba6a79dc5a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:27.004045 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6c6604f-fff4-45c5-aa90-4dba6a79dc5a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:27.171688 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e6c6604f-fff4-45c5-aa90-4dba6a79dc5a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:27.180182 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e6c6604f-fff4-45c5-aa90-4dba6a79dc5a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.192939 Sep 27 16:38:27.180842 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 92/183] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:26 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:27.429688 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-effda780-d169-4c62-a858-d2866d9f0b4f tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "DELETE /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 204 len: 0 microversion: 2.1 time: 0.608831 Sep 27 16:38:27.430291 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 92/184] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:38:26 2022] DELETE /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 16:38:27.441590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-784a7c18-ab94-484e-b324-6acbd67d5a67 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:27.442210 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-784a7c18-ab94-484e-b324-6acbd67d5a67 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:27.459635 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-784a7c18-ab94-484e-b324-6acbd67d5a67 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:27.460134 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-784a7c18-ab94-484e-b324-6acbd67d5a67 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:27.460573 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-784a7c18-ab94-484e-b324-6acbd67d5a67 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:27.464676 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-784a7c18-ab94-484e-b324-6acbd67d5a67 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:27.464676 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-784a7c18-ab94-484e-b324-6acbd67d5a67 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:27.464676 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-784a7c18-ab94-484e-b324-6acbd67d5a67 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:27.619254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-784a7c18-ab94-484e-b324-6acbd67d5a67 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1036377d4d94bb3a929aee17ca5eeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808169451dd64aa1a6a656ed9abbe5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:27.630335 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-784a7c18-ab94-484e-b324-6acbd67d5a67 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 200 len: 1469 microversion: 2.1 time: 0.192302 Sep 27 16:38:27.631473 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 93/185] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:27 2022] GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 1469 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:27.820446 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d41174fa-fd73-4f06-a356-45752b31c843 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:27.824232 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d41174fa-fd73-4f06-a356-45752b31c843 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:27.831371 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d41174fa-fd73-4f06-a356-45752b31c843 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:27.831851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d41174fa-fd73-4f06-a356-45752b31c843 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:27.832433 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d41174fa-fd73-4f06-a356-45752b31c843 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:27.833671 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d41174fa-fd73-4f06-a356-45752b31c843 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:27.833758 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d41174fa-fd73-4f06-a356-45752b31c843 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:27.834124 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d41174fa-fd73-4f06-a356-45752b31c843 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:27.980099 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d41174fa-fd73-4f06-a356-45752b31c843 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:27.987951 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d41174fa-fd73-4f06-a356-45752b31c843 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5" status: 200 len: 1314 microversion: 2.1 time: 0.186204 Sep 27 16:38:27.988537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 93/186] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:27 2022] GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:28.014387 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e93b9306-0c23-4150-a463-a1fad809aa40 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:28.015173 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e93b9306-0c23-4150-a463-a1fad809aa40 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:28.021417 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e93b9306-0c23-4150-a463-a1fad809aa40 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:28.021904 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e93b9306-0c23-4150-a463-a1fad809aa40 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:28.022339 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e93b9306-0c23-4150-a463-a1fad809aa40 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:28.023056 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e93b9306-0c23-4150-a463-a1fad809aa40 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:28.024029 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e93b9306-0c23-4150-a463-a1fad809aa40 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:28.024463 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e93b9306-0c23-4150-a463-a1fad809aa40 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:28.172612 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e93b9306-0c23-4150-a463-a1fad809aa40 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:28.181515 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e93b9306-0c23-4150-a463-a1fad809aa40 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:28.188289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e93b9306-0c23-4150-a463-a1fad809aa40 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:28.190344 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e93b9306-0c23-4150-a463-a1fad809aa40 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1723 microversion: 2.20 time: 0.180223 Sep 27 16:38:28.193466 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 94/187] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:28 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:38:28.220865 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-76c86406-5624-4224-afad-21a7d344204b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:28.221788 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-76c86406-5624-4224-afad-21a7d344204b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:28.239047 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-76c86406-5624-4224-afad-21a7d344204b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:28.239047 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-76c86406-5624-4224-afad-21a7d344204b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:28.239047 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-76c86406-5624-4224-afad-21a7d344204b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:28.239047 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-76c86406-5624-4224-afad-21a7d344204b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:28.239690 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-76c86406-5624-4224-afad-21a7d344204b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:28.239690 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-76c86406-5624-4224-afad-21a7d344204b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:28.422532 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-76c86406-5624-4224-afad-21a7d344204b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:28.431136 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-76c86406-5624-4224-afad-21a7d344204b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.226629 Sep 27 16:38:28.434867 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 94/188] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:28 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:28.657985 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d72e0bcf-892e-497f-a367-76ad09a507f0 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:28.659165 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d72e0bcf-892e-497f-a367-76ad09a507f0 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:28.665308 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d72e0bcf-892e-497f-a367-76ad09a507f0 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:28.666104 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d72e0bcf-892e-497f-a367-76ad09a507f0 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:28.667205 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d72e0bcf-892e-497f-a367-76ad09a507f0 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:28.668345 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d72e0bcf-892e-497f-a367-76ad09a507f0 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:28.668810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d72e0bcf-892e-497f-a367-76ad09a507f0 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:28.669240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d72e0bcf-892e-497f-a367-76ad09a507f0 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:29.013096 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a2d12b7a-b384-45b7-9f4c-259f9f635157 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:29.013830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a2d12b7a-b384-45b7-9f4c-259f9f635157 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:29.029754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a2d12b7a-b384-45b7-9f4c-259f9f635157 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:29.030477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a2d12b7a-b384-45b7-9f4c-259f9f635157 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:29.035672 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a2d12b7a-b384-45b7-9f4c-259f9f635157 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:29.035672 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a2d12b7a-b384-45b7-9f4c-259f9f635157 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:29.035672 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a2d12b7a-b384-45b7-9f4c-259f9f635157 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:29.035672 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a2d12b7a-b384-45b7-9f4c-259f9f635157 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:29.116800 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d72e0bcf-892e-497f-a367-76ad09a507f0 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1036377d4d94bb3a929aee17ca5eeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808169451dd64aa1a6a656ed9abbe5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:29.126199 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d72e0bcf-892e-497f-a367-76ad09a507f0 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 200 len: 1469 microversion: 2.1 time: 0.471807 Sep 27 16:38:29.127595 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 95/189] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:28 2022] GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 1469 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:29.220825 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ad420c63-9b3d-49e7-a8cb-3186cfbea55e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:29.221443 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ad420c63-9b3d-49e7-a8cb-3186cfbea55e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:29.231430 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ad420c63-9b3d-49e7-a8cb-3186cfbea55e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:29.232161 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ad420c63-9b3d-49e7-a8cb-3186cfbea55e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:29.232573 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ad420c63-9b3d-49e7-a8cb-3186cfbea55e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:29.238933 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ad420c63-9b3d-49e7-a8cb-3186cfbea55e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:29.239583 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ad420c63-9b3d-49e7-a8cb-3186cfbea55e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:29.240291 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ad420c63-9b3d-49e7-a8cb-3186cfbea55e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:29.392678 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a2d12b7a-b384-45b7-9f4c-259f9f635157 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:29.408677 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a2d12b7a-b384-45b7-9f4c-259f9f635157 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5" status: 200 len: 1314 microversion: 2.1 time: 0.399798 Sep 27 16:38:29.410713 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 95/190] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:29 2022] GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:29.454971 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dcd10da9-175a-4b56-b776-a453999db763 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:29.456257 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-dcd10da9-175a-4b56-b776-a453999db763 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:29.473226 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dcd10da9-175a-4b56-b776-a453999db763 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:29.476525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dcd10da9-175a-4b56-b776-a453999db763 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:29.477418 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dcd10da9-175a-4b56-b776-a453999db763 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:29.481075 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dcd10da9-175a-4b56-b776-a453999db763 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:29.481754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dcd10da9-175a-4b56-b776-a453999db763 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:29.482356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dcd10da9-175a-4b56-b776-a453999db763 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:29.520931 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ad420c63-9b3d-49e7-a8cb-3186cfbea55e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:29.530338 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ad420c63-9b3d-49e7-a8cb-3186cfbea55e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:29.532063 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ad420c63-9b3d-49e7-a8cb-3186cfbea55e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:29.537629 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ad420c63-9b3d-49e7-a8cb-3186cfbea55e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1723 microversion: 2.20 time: 0.320930 Sep 27 16:38:29.539406 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 96/191] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:29 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:38:29.856159 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dcd10da9-175a-4b56-b776-a453999db763 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:29.869768 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-dcd10da9-175a-4b56-b776-a453999db763 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.419214 Sep 27 16:38:29.875550 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 96/192] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:29 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:30.149914 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-51ad5b5c-a7f6-423b-bc3b-f68ca212a99e tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:30.150456 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-51ad5b5c-a7f6-423b-bc3b-f68ca212a99e tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:30.169624 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51ad5b5c-a7f6-423b-bc3b-f68ca212a99e tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:30.170185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51ad5b5c-a7f6-423b-bc3b-f68ca212a99e tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:30.170692 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51ad5b5c-a7f6-423b-bc3b-f68ca212a99e tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:30.171507 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51ad5b5c-a7f6-423b-bc3b-f68ca212a99e tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:30.171976 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51ad5b5c-a7f6-423b-bc3b-f68ca212a99e tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:30.172417 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51ad5b5c-a7f6-423b-bc3b-f68ca212a99e tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:30.407961 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-51ad5b5c-a7f6-423b-bc3b-f68ca212a99e tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1036377d4d94bb3a929aee17ca5eeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808169451dd64aa1a6a656ed9abbe5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:30.420664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-51ad5b5c-a7f6-423b-bc3b-f68ca212a99e tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 200 len: 1469 microversion: 2.1 time: 0.274694 Sep 27 16:38:30.422410 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 97/193] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:30 2022] GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 1469 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:30.434091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b0cfc69a-9a9c-42b6-a6fe-e9cdfe8464b7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:30.435409 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b0cfc69a-9a9c-42b6-a6fe-e9cdfe8464b7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:30.450724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0cfc69a-9a9c-42b6-a6fe-e9cdfe8464b7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:30.454457 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0cfc69a-9a9c-42b6-a6fe-e9cdfe8464b7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:30.455048 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0cfc69a-9a9c-42b6-a6fe-e9cdfe8464b7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:30.455882 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0cfc69a-9a9c-42b6-a6fe-e9cdfe8464b7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:30.456445 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0cfc69a-9a9c-42b6-a6fe-e9cdfe8464b7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:30.459227 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0cfc69a-9a9c-42b6-a6fe-e9cdfe8464b7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:30.571934 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0554248c-38f1-44e8-a567-4f86483887fc tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:30.572706 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0554248c-38f1-44e8-a567-4f86483887fc tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:30.581085 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0554248c-38f1-44e8-a567-4f86483887fc tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:30.581873 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0554248c-38f1-44e8-a567-4f86483887fc tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:30.582876 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0554248c-38f1-44e8-a567-4f86483887fc tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:30.583846 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0554248c-38f1-44e8-a567-4f86483887fc tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:30.584527 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0554248c-38f1-44e8-a567-4f86483887fc tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:30.585150 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0554248c-38f1-44e8-a567-4f86483887fc tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:30.725734 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b0cfc69a-9a9c-42b6-a6fe-e9cdfe8464b7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:30.735319 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b0cfc69a-9a9c-42b6-a6fe-e9cdfe8464b7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5" status: 200 len: 1314 microversion: 2.1 time: 0.305625 Sep 27 16:38:30.740748 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 97/194] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:30 2022] GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:30.901450 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fc817b75-b7cf-4aae-8c7a-1f8e6303cdff tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:30.906256 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fc817b75-b7cf-4aae-8c7a-1f8e6303cdff tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:30.912402 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc817b75-b7cf-4aae-8c7a-1f8e6303cdff tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:30.912957 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc817b75-b7cf-4aae-8c7a-1f8e6303cdff tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:30.914012 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc817b75-b7cf-4aae-8c7a-1f8e6303cdff tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:30.914545 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc817b75-b7cf-4aae-8c7a-1f8e6303cdff tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:30.914545 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc817b75-b7cf-4aae-8c7a-1f8e6303cdff tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:30.914938 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc817b75-b7cf-4aae-8c7a-1f8e6303cdff tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:31.145285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0554248c-38f1-44e8-a567-4f86483887fc tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:31.163315 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0554248c-38f1-44e8-a567-4f86483887fc tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:31.167409 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0554248c-38f1-44e8-a567-4f86483887fc tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:31.168639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0554248c-38f1-44e8-a567-4f86483887fc tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1723 microversion: 2.20 time: 0.601518 Sep 27 16:38:31.182826 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 98/195] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:30 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1723 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:38:31.209694 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-566c4a83-fed7-4f89-b928-3214f129103c req-3a54c664-1525-4951-bd98-15ea6f2f469d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26a5e8aa-3521-49a9-9fda-15333f231793", "name": "network-vif-deleted", "tag": "6c365b2d-c90e-47bb-a27e-019faaa15085"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:31.248306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-566c4a83-fed7-4f89-b928-3214f129103c req-3a54c664-1525-4951-bd98-15ea6f2f469d service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:31.249105 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-566c4a83-fed7-4f89-b928-3214f129103c req-3a54c664-1525-4951-bd98-15ea6f2f469d service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:31.249401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-566c4a83-fed7-4f89-b928-3214f129103c req-3a54c664-1525-4951-bd98-15ea6f2f469d service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:31.346240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-566c4a83-fed7-4f89-b928-3214f129103c req-3a54c664-1525-4951-bd98-15ea6f2f469d service nova] Creating event network-vif-deleted:6c365b2d-c90e-47bb-a27e-019faaa15085 for instance 26a5e8aa-3521-49a9-9fda-15333f231793 on hv-cinder-85506 Sep 27 16:38:31.376050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-566c4a83-fed7-4f89-b928-3214f129103c req-3a54c664-1525-4951-bd98-15ea6f2f469d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173983 Sep 27 16:38:31.378570 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 99/196] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:38:31.450541 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fc817b75-b7cf-4aae-8c7a-1f8e6303cdff tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:31.453626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6a4e8f91-1f68-4952-b5cb-0bcab9f4fd62 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:31.454364 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6a4e8f91-1f68-4952-b5cb-0bcab9f4fd62 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:31.474703 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fc817b75-b7cf-4aae-8c7a-1f8e6303cdff tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.577922 Sep 27 16:38:31.484262 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 98/197] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:30 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:38:31.487440 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a4e8f91-1f68-4952-b5cb-0bcab9f4fd62 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:31.487935 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a4e8f91-1f68-4952-b5cb-0bcab9f4fd62 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:31.488368 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a4e8f91-1f68-4952-b5cb-0bcab9f4fd62 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:31.489128 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a4e8f91-1f68-4952-b5cb-0bcab9f4fd62 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:31.489583 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a4e8f91-1f68-4952-b5cb-0bcab9f4fd62 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:31.490004 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a4e8f91-1f68-4952-b5cb-0bcab9f4fd62 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:31.659582 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-7d9f77a6-3c6a-4d94-8887-bc6a3ff3278e req-d53868b3-b94d-4e3a-89ee-f4779a405a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ad241be-370b-4cff-b34d-beea9d6842c5", "name": "network-vif-plugged", "status": "completed", "tag": "3f66f8e0-df9b-4202-aca4-c6652f4a9852"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:31.664129 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6a4e8f91-1f68-4952-b5cb-0bcab9f4fd62 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1036377d4d94bb3a929aee17ca5eeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808169451dd64aa1a6a656ed9abbe5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:31.675475 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6a4e8f91-1f68-4952-b5cb-0bcab9f4fd62 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 200 len: 1299 microversion: 2.1 time: 0.231278 Sep 27 16:38:31.679268 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 100/198] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:31 2022] GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 1299 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:38:31.691650 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-7d9f77a6-3c6a-4d94-8887-bc6a3ff3278e req-d53868b3-b94d-4e3a-89ee-f4779a405a40 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:31.695786 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-7d9f77a6-3c6a-4d94-8887-bc6a3ff3278e req-d53868b3-b94d-4e3a-89ee-f4779a405a40 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:31.696245 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-7d9f77a6-3c6a-4d94-8887-bc6a3ff3278e req-d53868b3-b94d-4e3a-89ee-f4779a405a40 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:31.726219 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-7d9f77a6-3c6a-4d94-8887-bc6a3ff3278e req-d53868b3-b94d-4e3a-89ee-f4779a405a40 service nova] Creating event network-vif-plugged:3f66f8e0-df9b-4202-aca4-c6652f4a9852 for instance 6ad241be-370b-4cff-b34d-beea9d6842c5 on hv-cinder-85506 Sep 27 16:38:31.741121 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-7d9f77a6-3c6a-4d94-8887-bc6a3ff3278e req-d53868b3-b94d-4e3a-89ee-f4779a405a40 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092921 Sep 27 16:38:31.747003 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 99/199] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:38:31.767562 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-662dea94-ae2a-4291-9c01-11ea079aeb40 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:31.768189 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-662dea94-ae2a-4291-9c01-11ea079aeb40 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:31.781128 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-662dea94-ae2a-4291-9c01-11ea079aeb40 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:31.781672 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-662dea94-ae2a-4291-9c01-11ea079aeb40 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:31.782119 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-662dea94-ae2a-4291-9c01-11ea079aeb40 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:31.783180 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-662dea94-ae2a-4291-9c01-11ea079aeb40 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:31.783658 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-662dea94-ae2a-4291-9c01-11ea079aeb40 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:31.784192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-662dea94-ae2a-4291-9c01-11ea079aeb40 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:32.165769 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-662dea94-ae2a-4291-9c01-11ea079aeb40 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:32.182927 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-662dea94-ae2a-4291-9c01-11ea079aeb40 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5" status: 200 len: 1314 microversion: 2.1 time: 0.418249 Sep 27 16:38:32.205810 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a4e731c4-c97d-49fb-8a5c-2039f5e3e80e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:32.206536 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a4e731c4-c97d-49fb-8a5c-2039f5e3e80e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:32.209439 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 101/200] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:31 2022] GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:32.214401 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4e731c4-c97d-49fb-8a5c-2039f5e3e80e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:32.215174 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4e731c4-c97d-49fb-8a5c-2039f5e3e80e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:32.219187 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4e731c4-c97d-49fb-8a5c-2039f5e3e80e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:32.219187 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4e731c4-c97d-49fb-8a5c-2039f5e3e80e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:32.219187 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4e731c4-c97d-49fb-8a5c-2039f5e3e80e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:32.219187 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4e731c4-c97d-49fb-8a5c-2039f5e3e80e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:32.493735 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9e203085-9123-41c8-a270-1126c3427579 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Action: 'create', calling method: .version_select at 0x7fa405a290d0>, body: {"keypair": {"name": "tempest-keypair-1283862905", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW5wEG880XWAU4oc09gRDTS5zP0pWzRWLZ9TsA37GSBtdYKJT/OJTfQl4czQnEtVg4xxvP42y2vmCXYcFsJq9KnSsAS9cOl2MmavFfdTrege0ywsQHch4x4hK32imX54A=="}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:32.515527 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-9e203085-9123-41c8-a270-1126c3427579 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Getting quotas for project 73fad530905b485cb7141793f6130a9e. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:38:32.520427 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-9e203085-9123-41c8-a270-1126c3427579 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Getting quotas for user e8d3af2b82b641aea11ebf79677a3af1 and project 73fad530905b485cb7141793f6130a9e. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:38:32.546344 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a4e731c4-c97d-49fb-8a5c-2039f5e3e80e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:32.577944 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a4e731c4-c97d-49fb-8a5c-2039f5e3e80e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:32.585534 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a4e731c4-c97d-49fb-8a5c-2039f5e3e80e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:32.591424 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a4e731c4-c97d-49fb-8a5c-2039f5e3e80e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1723 microversion: 2.20 time: 0.394432 Sep 27 16:38:32.598619 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 100/201] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:32 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1723 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:38:32.604218 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0904805c-36f5-4dde-85fe-ffb520158d42 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:32.607908 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0904805c-36f5-4dde-85fe-ffb520158d42 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:32.622178 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0904805c-36f5-4dde-85fe-ffb520158d42 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:32.625716 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0904805c-36f5-4dde-85fe-ffb520158d42 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:32.625716 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0904805c-36f5-4dde-85fe-ffb520158d42 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:32.625716 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0904805c-36f5-4dde-85fe-ffb520158d42 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:32.625716 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0904805c-36f5-4dde-85fe-ffb520158d42 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:32.626013 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0904805c-36f5-4dde-85fe-ffb520158d42 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:32.659291 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9e203085-9123-41c8-a270-1126c3427579 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.169290 Sep 27 16:38:32.660560 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 102/202] 10.222.0.64 () {60 vars in 1159 bytes} [Tue Sep 27 16:38:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:38:32.700414 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6b6c9b70-7004-43e0-a0ff-acde1cb9c7ba tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:32.701272 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6b6c9b70-7004-43e0-a0ff-acde1cb9c7ba tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:32.712756 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b6c9b70-7004-43e0-a0ff-acde1cb9c7ba tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:32.714050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b6c9b70-7004-43e0-a0ff-acde1cb9c7ba tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:32.716903 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b6c9b70-7004-43e0-a0ff-acde1cb9c7ba tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:32.718849 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b6c9b70-7004-43e0-a0ff-acde1cb9c7ba tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:32.720473 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b6c9b70-7004-43e0-a0ff-acde1cb9c7ba tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:32.726094 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b6c9b70-7004-43e0-a0ff-acde1cb9c7ba tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:32.823867 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b6c9b70-7004-43e0-a0ff-acde1cb9c7ba tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:32.826769 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b6c9b70-7004-43e0-a0ff-acde1cb9c7ba tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:32.827514 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b6c9b70-7004-43e0-a0ff-acde1cb9c7ba tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:32.831093 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-6b6c9b70-7004-43e0-a0ff-acde1cb9c7ba tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lazy-loading 'fault' on Instance uuid 26a5e8aa-3521-49a9-9fda-15333f231793 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:38:32.857527 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0904805c-36f5-4dde-85fe-ffb520158d42 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:32.869533 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0904805c-36f5-4dde-85fe-ffb520158d42 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.268882 Sep 27 16:38:32.869843 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 101/203] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:32 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:32.904028 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6b6c9b70-7004-43e0-a0ff-acde1cb9c7ba tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1036377d4d94bb3a929aee17ca5eeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808169451dd64aa1a6a656ed9abbe5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:32.912595 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6b6c9b70-7004-43e0-a0ff-acde1cb9c7ba tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 200 len: 1304 microversion: 2.1 time: 0.217072 Sep 27 16:38:32.913168 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 103/204] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:32 2022] GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 1304 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:33.210834 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3105aa0a-7669-45a4-a37e-79322f8f8b57 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:33.210834 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3105aa0a-7669-45a4-a37e-79322f8f8b57 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:33.222074 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3105aa0a-7669-45a4-a37e-79322f8f8b57 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:33.223289 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3105aa0a-7669-45a4-a37e-79322f8f8b57 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:33.223740 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3105aa0a-7669-45a4-a37e-79322f8f8b57 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:33.224456 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3105aa0a-7669-45a4-a37e-79322f8f8b57 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:33.227355 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3105aa0a-7669-45a4-a37e-79322f8f8b57 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:33.227970 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3105aa0a-7669-45a4-a37e-79322f8f8b57 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:33.626856 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-617976a3-6a44-4aa7-894e-35da41fafe98 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:33.626856 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-617976a3-6a44-4aa7-894e-35da41fafe98 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:33.643828 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-617976a3-6a44-4aa7-894e-35da41fafe98 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:33.644643 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-617976a3-6a44-4aa7-894e-35da41fafe98 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:33.645236 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-617976a3-6a44-4aa7-894e-35da41fafe98 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:33.646117 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-617976a3-6a44-4aa7-894e-35da41fafe98 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:33.646729 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-617976a3-6a44-4aa7-894e-35da41fafe98 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:33.647328 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-617976a3-6a44-4aa7-894e-35da41fafe98 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:34.171315 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3105aa0a-7669-45a4-a37e-79322f8f8b57 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:34.185690 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3105aa0a-7669-45a4-a37e-79322f8f8b57 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5" status: 200 len: 1314 microversion: 2.1 time: 0.979306 Sep 27 16:38:34.186691 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 102/205] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:33 2022] GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 => generated 1314 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:34.194382 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a7f0b43c-cd86-40d0-bb2a-3b4e64ceae4e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:34.194382 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a7f0b43c-cd86-40d0-bb2a-3b4e64ceae4e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:34.199168 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7f0b43c-cd86-40d0-bb2a-3b4e64ceae4e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:34.199922 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7f0b43c-cd86-40d0-bb2a-3b4e64ceae4e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:34.200560 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7f0b43c-cd86-40d0-bb2a-3b4e64ceae4e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:34.201490 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7f0b43c-cd86-40d0-bb2a-3b4e64ceae4e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:34.202164 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7f0b43c-cd86-40d0-bb2a-3b4e64ceae4e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:34.202648 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7f0b43c-cd86-40d0-bb2a-3b4e64ceae4e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:34.206212 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-617976a3-6a44-4aa7-894e-35da41fafe98 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:34.214744 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-617976a3-6a44-4aa7-894e-35da41fafe98 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:34.216243 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-617976a3-6a44-4aa7-894e-35da41fafe98 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:34.217491 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-617976a3-6a44-4aa7-894e-35da41fafe98 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1723 microversion: 2.20 time: 0.596615 Sep 27 16:38:34.218235 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 104/206] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:33 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1723 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:38:34.238499 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ff01e047-1294-4de3-8754-e526d0752320 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:34.239175 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ff01e047-1294-4de3-8754-e526d0752320 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] [instance: 26a5e8aa-3521-49a9-9fda-15333f231793] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:34.245983 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff01e047-1294-4de3-8754-e526d0752320 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:34.246686 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff01e047-1294-4de3-8754-e526d0752320 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:34.247095 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff01e047-1294-4de3-8754-e526d0752320 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:34.247804 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff01e047-1294-4de3-8754-e526d0752320 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:34.248262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff01e047-1294-4de3-8754-e526d0752320 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:34.248682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff01e047-1294-4de3-8754-e526d0752320 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:34.265935 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-ff01e047-1294-4de3-8754-e526d0752320 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] HTTP exception thrown: Instance 26a5e8aa-3521-49a9-9fda-15333f231793 could not be found. Sep 27 16:38:34.267616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ff01e047-1294-4de3-8754-e526d0752320 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Request method failure captured: Sep 27 16:38:34.267616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 HTTP/1.1 Sep 27 16:38:34.267616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:38:34.267616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:38:34.267616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:38:34.267616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:38:34.267616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:38:34.267616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:38:34.267616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:38:34.267616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:38:34.267616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMybqZ5rkmrOuuL2f0J2tGRHDxa0DsRdqli3hcQXfQVudqWVEefArX83_tQyRpqtXKNKWmFim2XiomD8BCJZoup-D8NQQSeW5Sny4UD5kuYhOXWA90tb7ERFoL_5YqF_y3ftcwfChFbKW-xSM0aYCpYdJk9CIE0hAgLiAUzBZE6yXyag Sep 27 16:38:34.267616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:38:34.267616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:38:34.267616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:38:34.267616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:38:34.267616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:38:34.267616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:38:34.267616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 808169451dd64aa1a6a656ed9abbe5a0 Sep 27 16:38:34.267616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesNegativeTest-1220044206 Sep 27 16:38:34.267616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:38:34.267616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:38:34.268896 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/808169451dd64aa1a6a656ed9abbe5a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_808169451dd64aa1a6a656ed9abbe5a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/808169451dd64aa1a6a656ed9abbe5a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/808169451dd64aa1a6a656ed9abbe5a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:38:34.268896 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesNegativeTest-1220044206 Sep 27 16:38:34.268896 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 808169451dd64aa1a6a656ed9abbe5a0 Sep 27 16:38:34.268896 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesNegativeTest-1220044206 Sep 27 16:38:34.268896 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesNegativeTest-1220044206-project Sep 27 16:38:34.268896 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:38:34.268896 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:38:34.268896 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: e1036377d4d94bb3a929aee17ca5eeec Sep 27 16:38:34.268896 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesNegativeTest-1220044206-project Sep 27 16:38:34.268896 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:38:34.268896 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Instance 26a5e8aa-3521-49a9-9fda-15333f231793 could not be found. Sep 27 16:38:34.268896 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': '26a5e8aa-3521-49a9-9fda-15333f231793'} Sep 27 16:38:34.269626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:38:34.269626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:38:34.269626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:38:34.269626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:38:34.269626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:38:34.269626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:38:34.269626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:38:34.269626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:38:34.269626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:38:34.269626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:38:34.269626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26a5e8aa-3521-49a9-9fda-15333f231793 could not be found. Sep 27 16:38:34.269626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:38:34.269626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:38:34.269626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:38:34.269626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:38:34.269626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:38:34.269626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:38:34.269626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:38:34.269626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:38:34.269626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:38:34.270829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:38:34.270829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:38:34.270829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:38:34.270829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:38:34.270829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:38:34.270829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:38:34.270829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:38:34.270829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26a5e8aa-3521-49a9-9fda-15333f231793 could not be found. Sep 27 16:38:34.270829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:38:34.270829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:38:34.270829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:38:34.270829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:38:34.270829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:38:34.270829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:38:34.270829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:38:34.270829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:38:34.270829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26a5e8aa-3521-49a9-9fda-15333f231793 could not be found. Sep 27 16:38:34.270829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:38:34.271885 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ff01e047-1294-4de3-8754-e526d0752320 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] Returning 404 to user: Instance 26a5e8aa-3521-49a9-9fda-15333f231793 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:38:34.271885 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ff01e047-1294-4de3-8754-e526d0752320 tempest-VolumesNegativeTest-1220044206 tempest-VolumesNegativeTest-1220044206-project] 10.222.0.64 "GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793" status: 404 len: 111 microversion: 2.1 time: 0.036883 Sep 27 16:38:34.271885 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 105/207] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:34 2022] GET /compute/v2.1/servers/26a5e8aa-3521-49a9-9fda-15333f231793 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:38:34.355900 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a7f0b43c-cd86-40d0-bb2a-3b4e64ceae4e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:34.363790 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a7f0b43c-cd86-40d0-bb2a-3b4e64ceae4e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.175894 Sep 27 16:38:34.364380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 103/208] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:34 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:35.209255 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6b4ebcbc-a38b-4d0c-a343-6ef4b01b21f4 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:35.209855 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6b4ebcbc-a38b-4d0c-a343-6ef4b01b21f4 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:35.226672 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b4ebcbc-a38b-4d0c-a343-6ef4b01b21f4 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:35.227495 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b4ebcbc-a38b-4d0c-a343-6ef4b01b21f4 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:35.228078 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b4ebcbc-a38b-4d0c-a343-6ef4b01b21f4 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:35.229014 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b4ebcbc-a38b-4d0c-a343-6ef4b01b21f4 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:35.229626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b4ebcbc-a38b-4d0c-a343-6ef4b01b21f4 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:35.230249 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b4ebcbc-a38b-4d0c-a343-6ef4b01b21f4 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:35.243373 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-aad4fc58-00ce-4e17-9d21-1f4974937988 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:35.243982 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-aad4fc58-00ce-4e17-9d21-1f4974937988 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:35.255989 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aad4fc58-00ce-4e17-9d21-1f4974937988 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:35.257349 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aad4fc58-00ce-4e17-9d21-1f4974937988 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:35.261196 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aad4fc58-00ce-4e17-9d21-1f4974937988 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:35.266454 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aad4fc58-00ce-4e17-9d21-1f4974937988 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:35.266454 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aad4fc58-00ce-4e17-9d21-1f4974937988 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:35.266454 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aad4fc58-00ce-4e17-9d21-1f4974937988 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:35.686457 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-aad4fc58-00ce-4e17-9d21-1f4974937988 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:35.700127 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6b4ebcbc-a38b-4d0c-a343-6ef4b01b21f4 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:35.703439 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-aad4fc58-00ce-4e17-9d21-1f4974937988 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:35.706464 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-aad4fc58-00ce-4e17-9d21-1f4974937988 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:35.710027 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6b4ebcbc-a38b-4d0c-a343-6ef4b01b21f4 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5" status: 200 len: 1499 microversion: 2.1 time: 0.504452 Sep 27 16:38:35.711875 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-aad4fc58-00ce-4e17-9d21-1f4974937988 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1723 microversion: 2.20 time: 0.471631 Sep 27 16:38:35.712646 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 104/209] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:35 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1723 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:38:35.723155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 106/210] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:35 2022] GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 => generated 1499 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:35.736876 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-965c8948-9315-4048-83fd-60bdd358466e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:35.741220 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-965c8948-9315-4048-83fd-60bdd358466e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:35.753560 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-965c8948-9315-4048-83fd-60bdd358466e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:35.754052 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-965c8948-9315-4048-83fd-60bdd358466e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:35.755604 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-965c8948-9315-4048-83fd-60bdd358466e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:35.757557 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-965c8948-9315-4048-83fd-60bdd358466e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:35.758030 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-965c8948-9315-4048-83fd-60bdd358466e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:35.758456 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-965c8948-9315-4048-83fd-60bdd358466e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:35.792199 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:35.974142 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-965c8948-9315-4048-83fd-60bdd358466e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:35.985379 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-965c8948-9315-4048-83fd-60bdd358466e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.269203 Sep 27 16:38:35.992210 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 105/211] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:35 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:36.697053 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e735804a-a876-4eac-8593-7419597ca1ab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-375775308", "imageRef": "6908a343-46fa-4801-bfb5-7ad92ac26956", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16983143-f1f9-476b-8846-75cee163a487"}], "security_groups": [{"name": "tempest-securitygroup--1988868948"}], "key_name": "tempest-keypair-1283862905", "user_data": "}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:36.741936 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4e68e3e9-446e-4f08-82bb-ff7e9995beae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:36.742566 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4e68e3e9-446e-4f08-82bb-ff7e9995beae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:36.756788 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4e68e3e9-446e-4f08-82bb-ff7e9995beae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:36.757329 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4e68e3e9-446e-4f08-82bb-ff7e9995beae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:36.758164 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4e68e3e9-446e-4f08-82bb-ff7e9995beae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:36.763012 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4e68e3e9-446e-4f08-82bb-ff7e9995beae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:36.763012 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4e68e3e9-446e-4f08-82bb-ff7e9995beae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:36.763012 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4e68e3e9-446e-4f08-82bb-ff7e9995beae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:37.013154 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4e68e3e9-446e-4f08-82bb-ff7e9995beae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:37.021764 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4e68e3e9-446e-4f08-82bb-ff7e9995beae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:37.023520 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4e68e3e9-446e-4f08-82bb-ff7e9995beae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:37.024996 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4e68e3e9-446e-4f08-82bb-ff7e9995beae tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1723 microversion: 2.20 time: 0.286927 Sep 27 16:38:37.027232 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 106/212] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:36 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:38:37.034429 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-efff9044-9570-4117-92bb-5ca211139ea3 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:37.035426 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-efff9044-9570-4117-92bb-5ca211139ea3 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:37.042958 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-efff9044-9570-4117-92bb-5ca211139ea3 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:37.043796 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-efff9044-9570-4117-92bb-5ca211139ea3 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:37.044405 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-efff9044-9570-4117-92bb-5ca211139ea3 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:37.045321 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-efff9044-9570-4117-92bb-5ca211139ea3 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:37.045898 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-efff9044-9570-4117-92bb-5ca211139ea3 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:37.046379 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-efff9044-9570-4117-92bb-5ca211139ea3 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:37.222629 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-efff9044-9570-4117-92bb-5ca211139ea3 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 16:38:37.621228 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-efff9044-9570-4117-92bb-5ca211139ea3 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5" status: 204 len: 0 microversion: 2.1 time: 0.592416 Sep 27 16:38:37.622195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-e735804a-a876-4eac-8593-7419597ca1ab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] validate_networks() for [('16983143-f1f9-476b-8846-75cee163a487', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 16:38:37.622421 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 107/213] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:38:37 2022] DELETE /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 16:38:37.633085 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a39c65c2-bc42-45fc-87b9-6f4a8a165ecc tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:37.636022 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a39c65c2-bc42-45fc-87b9-6f4a8a165ecc tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:37.656437 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a39c65c2-bc42-45fc-87b9-6f4a8a165ecc tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:37.657303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a39c65c2-bc42-45fc-87b9-6f4a8a165ecc tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:37.658094 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a39c65c2-bc42-45fc-87b9-6f4a8a165ecc tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:37.659248 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a39c65c2-bc42-45fc-87b9-6f4a8a165ecc tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:37.659935 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a39c65c2-bc42-45fc-87b9-6f4a8a165ecc tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:37.660948 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a39c65c2-bc42-45fc-87b9-6f4a8a165ecc tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:37.885277 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a39c65c2-bc42-45fc-87b9-6f4a8a165ecc tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:37.897922 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a39c65c2-bc42-45fc-87b9-6f4a8a165ecc tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.270916 Sep 27 16:38:37.898511 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 108/214] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:37 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:37.921240 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6485b202-8e4e-44cc-bf67-d6b7f4dd9f2e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:37.927533 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6485b202-8e4e-44cc-bf67-d6b7f4dd9f2e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:37.946420 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6485b202-8e4e-44cc-bf67-d6b7f4dd9f2e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:37.947327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6485b202-8e4e-44cc-bf67-d6b7f4dd9f2e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:37.947968 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6485b202-8e4e-44cc-bf67-d6b7f4dd9f2e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:37.949872 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6485b202-8e4e-44cc-bf67-d6b7f4dd9f2e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:37.952149 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6485b202-8e4e-44cc-bf67-d6b7f4dd9f2e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:37.952798 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6485b202-8e4e-44cc-bf67-d6b7f4dd9f2e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:38.236613 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6485b202-8e4e-44cc-bf67-d6b7f4dd9f2e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:38.245368 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6485b202-8e4e-44cc-bf67-d6b7f4dd9f2e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5" status: 200 len: 1505 microversion: 2.1 time: 0.336383 Sep 27 16:38:38.258864 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 109/215] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:37 2022] GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 => generated 1505 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:38.258864 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8d0623f5-8397-4f21-985f-05412c0f94cd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1223993121", "imageRef": "6908a343-46fa-4801-bfb5-7ad92ac26956", "flavorRef": "452", "networks": [{"uuid": "1d57f70d-1b9d-4c97-96ff-4182fbfe33f5"}]}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:38.303155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-e735804a-a876-4eac-8593-7419597ca1ab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 16:38:38.304198 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-e735804a-a876-4eac-8593-7419597ca1ab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 16:38:38.304893 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-e735804a-a876-4eac-8593-7419597ca1ab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 16:38:38.305510 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-e735804a-a876-4eac-8593-7419597ca1ab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 16:38:38.306194 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-e735804a-a876-4eac-8593-7419597ca1ab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 16:38:38.316110 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e735804a-a876-4eac-8593-7419597ca1ab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:38.316624 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e735804a-a876-4eac-8593-7419597ca1ab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:38.317051 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e735804a-a876-4eac-8593-7419597ca1ab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:38.317813 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e735804a-a876-4eac-8593-7419597ca1ab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:38.318288 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e735804a-a876-4eac-8593-7419597ca1ab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:38.318762 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e735804a-a876-4eac-8593-7419597ca1ab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:38.344120 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-e735804a-a876-4eac-8593-7419597ca1ab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Getting quotas for project 73fad530905b485cb7141793f6130a9e. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:38:38.344120 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-e735804a-a876-4eac-8593-7419597ca1ab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Getting quotas for user e8d3af2b82b641aea11ebf79677a3af1 and project 73fad530905b485cb7141793f6130a9e. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:38:38.357007 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e735804a-a876-4eac-8593-7419597ca1ab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 16:38:38.359533 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e735804a-a876-4eac-8593-7419597ca1ab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6908a343-46fa-4801-bfb5-7ad92ac26956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 16:38:38.768777 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e735804a-a876-4eac-8593-7419597ca1ab tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.075924 Sep 27 16:38:38.769415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 107/216] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Sep 27 16:38:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 2077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 16:38:38.773933 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5dc8d119-3eba-48b3-a94f-b1b5576b9449 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:38.774533 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5dc8d119-3eba-48b3-a94f-b1b5576b9449 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:38.781452 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5dc8d119-3eba-48b3-a94f-b1b5576b9449 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:38.781836 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5dc8d119-3eba-48b3-a94f-b1b5576b9449 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:38.782275 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5dc8d119-3eba-48b3-a94f-b1b5576b9449 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:38.783007 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5dc8d119-3eba-48b3-a94f-b1b5576b9449 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:38.785583 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5dc8d119-3eba-48b3-a94f-b1b5576b9449 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:38.786132 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5dc8d119-3eba-48b3-a94f-b1b5576b9449 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:38.953980 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5dc8d119-3eba-48b3-a94f-b1b5576b9449 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:38.962573 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5dc8d119-3eba-48b3-a94f-b1b5576b9449 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:38.964622 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5dc8d119-3eba-48b3-a94f-b1b5576b9449 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:38.965796 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5dc8d119-3eba-48b3-a94f-b1b5576b9449 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1723 microversion: 2.20 time: 0.195463 Sep 27 16:38:38.986973 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 108/217] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:38 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:38:38.999423 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f7666041-299a-458a-8d48-a871b3c2568e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:38.999872 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f7666041-299a-458a-8d48-a871b3c2568e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:39.081676 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f7666041-299a-458a-8d48-a871b3c2568e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:39.090263 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f7666041-299a-458a-8d48-a871b3c2568e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 200 len: 1241 microversion: 2.1 time: 0.102044 Sep 27 16:38:39.099537 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 109/218] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:38 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 1241 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:39.115995 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f00fd56f-54df-43c1-a8bb-669900e21428 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:39.116881 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f00fd56f-54df-43c1-a8bb-669900e21428 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:39.127511 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f00fd56f-54df-43c1-a8bb-669900e21428 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:39.128367 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f00fd56f-54df-43c1-a8bb-669900e21428 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:39.129495 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f00fd56f-54df-43c1-a8bb-669900e21428 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:39.130420 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f00fd56f-54df-43c1-a8bb-669900e21428 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:39.131116 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f00fd56f-54df-43c1-a8bb-669900e21428 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:39.131736 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f00fd56f-54df-43c1-a8bb-669900e21428 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:39.160509 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:39.187053 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-8d0623f5-8397-4f21-985f-05412c0f94cd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] validate_networks() for [('1d57f70d-1b9d-4c97-96ff-4182fbfe33f5', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 16:38:39.501598 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f00fd56f-54df-43c1-a8bb-669900e21428 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:39.505029 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f00fd56f-54df-43c1-a8bb-669900e21428 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.404178 Sep 27 16:38:39.505613 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 110/219] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:39 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:39.512367 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-49743de7-a4f8-43da-af07-7a64a26d3e69 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:39.513269 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-49743de7-a4f8-43da-af07-7a64a26d3e69 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:39.538023 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-49743de7-a4f8-43da-af07-7a64a26d3e69 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:39.545871 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-49743de7-a4f8-43da-af07-7a64a26d3e69 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:39.545871 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-49743de7-a4f8-43da-af07-7a64a26d3e69 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:39.545871 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-49743de7-a4f8-43da-af07-7a64a26d3e69 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:39.545871 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-49743de7-a4f8-43da-af07-7a64a26d3e69 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:39.546321 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-49743de7-a4f8-43da-af07-7a64a26d3e69 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:39.806322 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-49743de7-a4f8-43da-af07-7a64a26d3e69 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:39.814595 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-49743de7-a4f8-43da-af07-7a64a26d3e69 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5" status: 200 len: 1505 microversion: 2.1 time: 0.307864 Sep 27 16:38:39.815218 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 111/220] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:39 2022] GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 => generated 1505 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:39.981987 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-8d0623f5-8397-4f21-985f-05412c0f94cd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 16:38:39.982751 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-8d0623f5-8397-4f21-985f-05412c0f94cd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 16:38:39.983494 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-8d0623f5-8397-4f21-985f-05412c0f94cd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 16:38:39.984092 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-8d0623f5-8397-4f21-985f-05412c0f94cd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 16:38:39.984763 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-8d0623f5-8397-4f21-985f-05412c0f94cd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 16:38:39.996996 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8d0623f5-8397-4f21-985f-05412c0f94cd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:39.997830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8d0623f5-8397-4f21-985f-05412c0f94cd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:39.998481 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8d0623f5-8397-4f21-985f-05412c0f94cd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:39.999946 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8d0623f5-8397-4f21-985f-05412c0f94cd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:40.000642 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8d0623f5-8397-4f21-985f-05412c0f94cd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:40.001282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8d0623f5-8397-4f21-985f-05412c0f94cd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:40.007869 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-662ead8f-b848-4ce6-9b28-cc3edec985ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:40.008960 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-662ead8f-b848-4ce6-9b28-cc3edec985ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:40.022585 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-8d0623f5-8397-4f21-985f-05412c0f94cd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Getting quotas for project a06947e0733946bb8e266382c0d4d0ce. Resources: {'instances', 'ram', 'cores'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:38:40.027860 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-8d0623f5-8397-4f21-985f-05412c0f94cd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Getting quotas for user 211efc6d124344c0b6ba83c378425df0 and project a06947e0733946bb8e266382c0d4d0ce. Resources: {'instances', 'ram', 'cores'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:38:40.031898 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-662ead8f-b848-4ce6-9b28-cc3edec985ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:40.032417 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-662ead8f-b848-4ce6-9b28-cc3edec985ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:40.032864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-662ead8f-b848-4ce6-9b28-cc3edec985ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:40.033587 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-662ead8f-b848-4ce6-9b28-cc3edec985ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:40.034046 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-662ead8f-b848-4ce6-9b28-cc3edec985ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:40.043646 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8d0623f5-8397-4f21-985f-05412c0f94cd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 16:38:40.044687 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-662ead8f-b848-4ce6-9b28-cc3edec985ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:40.047080 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8d0623f5-8397-4f21-985f-05412c0f94cd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6908a343-46fa-4801-bfb5-7ad92ac26956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 16:38:40.236862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8d0623f5-8397-4f21-985f-05412c0f94cd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.989655 Sep 27 16:38:40.238796 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 110/221] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Sep 27 16:38:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 16:38:40.260668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b9438a2e-45f1-43c0-a0fa-e45b7ecc5eb0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:40.264152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b9438a2e-45f1-43c0-a0fa-e45b7ecc5eb0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:40.271943 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-662ead8f-b848-4ce6-9b28-cc3edec985ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:40.287265 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b9438a2e-45f1-43c0-a0fa-e45b7ecc5eb0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:40.303861 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-662ead8f-b848-4ce6-9b28-cc3edec985ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:40.306468 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-662ead8f-b848-4ce6-9b28-cc3edec985ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:40.308004 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-662ead8f-b848-4ce6-9b28-cc3edec985ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1744 microversion: 2.20 time: 0.305148 Sep 27 16:38:40.309064 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 112/222] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:39 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1744 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:38:40.314970 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ba64c4d7-d27b-4129-a0a0-401ddf3b2991 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:40.315767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ba64c4d7-d27b-4129-a0a0-401ddf3b2991 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:40.320446 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b9438a2e-45f1-43c0-a0fa-e45b7ecc5eb0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:40.320937 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b9438a2e-45f1-43c0-a0fa-e45b7ecc5eb0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:40.326520 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b9438a2e-45f1-43c0-a0fa-e45b7ecc5eb0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:40.327847 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b9438a2e-45f1-43c0-a0fa-e45b7ecc5eb0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:40.329487 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b9438a2e-45f1-43c0-a0fa-e45b7ecc5eb0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:40.503914 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ba64c4d7-d27b-4129-a0a0-401ddf3b2991 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:40.510891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ba64c4d7-d27b-4129-a0a0-401ddf3b2991 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 200 len: 1219 microversion: 2.1 time: 0.198664 Sep 27 16:38:40.513234 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 113/223] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:40 2022] GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 1219 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:40.517585 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b9438a2e-45f1-43c0-a0fa-e45b7ecc5eb0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:40.530946 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b9438a2e-45f1-43c0-a0fa-e45b7ecc5eb0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 200 len: 1245 microversion: 2.1 time: 0.285485 Sep 27 16:38:40.543964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 111/224] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:40 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 1245 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:40.544955 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bedf9f0f-c17e-4d8f-87c6-9f74f531796c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:40.550084 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bedf9f0f-c17e-4d8f-87c6-9f74f531796c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:40.591204 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bedf9f0f-c17e-4d8f-87c6-9f74f531796c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:40.601075 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bedf9f0f-c17e-4d8f-87c6-9f74f531796c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:40.604584 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bedf9f0f-c17e-4d8f-87c6-9f74f531796c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:40.607578 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bedf9f0f-c17e-4d8f-87c6-9f74f531796c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:40.608290 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bedf9f0f-c17e-4d8f-87c6-9f74f531796c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:40.610894 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bedf9f0f-c17e-4d8f-87c6-9f74f531796c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:40.616867 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-5de6f6c8-c2cd-4ec8-9ebe-b432157d10e1 req-e71265aa-d566-4c25-bf49-821e3e1efafe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ad241be-370b-4cff-b34d-beea9d6842c5", "name": "network-vif-deleted", "tag": "3f66f8e0-df9b-4202-aca4-c6652f4a9852"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:40.655365 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:40.671682 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-5de6f6c8-c2cd-4ec8-9ebe-b432157d10e1 req-e71265aa-d566-4c25-bf49-821e3e1efafe service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:40.672182 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-5de6f6c8-c2cd-4ec8-9ebe-b432157d10e1 req-e71265aa-d566-4c25-bf49-821e3e1efafe service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:40.672620 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-5de6f6c8-c2cd-4ec8-9ebe-b432157d10e1 req-e71265aa-d566-4c25-bf49-821e3e1efafe service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:40.727874 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-5de6f6c8-c2cd-4ec8-9ebe-b432157d10e1 req-e71265aa-d566-4c25-bf49-821e3e1efafe service nova] Creating event network-vif-deleted:3f66f8e0-df9b-4202-aca4-c6652f4a9852 for instance 6ad241be-370b-4cff-b34d-beea9d6842c5 on hv-cinder-85506 Sep 27 16:38:40.739225 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-5de6f6c8-c2cd-4ec8-9ebe-b432157d10e1 req-e71265aa-d566-4c25-bf49-821e3e1efafe service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126289 Sep 27 16:38:40.750809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 112/225] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:38:40.843587 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ee94ee81-79c8-4002-8aa8-624eb6786db7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:40.844300 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ee94ee81-79c8-4002-8aa8-624eb6786db7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:40.857867 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee94ee81-79c8-4002-8aa8-624eb6786db7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:40.858365 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee94ee81-79c8-4002-8aa8-624eb6786db7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:40.858813 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee94ee81-79c8-4002-8aa8-624eb6786db7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:40.859532 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee94ee81-79c8-4002-8aa8-624eb6786db7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:40.859994 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee94ee81-79c8-4002-8aa8-624eb6786db7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:40.860423 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee94ee81-79c8-4002-8aa8-624eb6786db7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:40.912670 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bedf9f0f-c17e-4d8f-87c6-9f74f531796c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:40.924865 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bedf9f0f-c17e-4d8f-87c6-9f74f531796c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.389642 Sep 27 16:38:40.941102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 114/226] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:40 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:41.004700 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ee94ee81-79c8-4002-8aa8-624eb6786db7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:41.027357 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ee94ee81-79c8-4002-8aa8-624eb6786db7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5" status: 200 len: 1299 microversion: 2.1 time: 0.188013 Sep 27 16:38:41.028252 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 113/227] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:40 2022] GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 => generated 1299 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:38:41.349128 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4a344847-f8d5-4432-ba3c-4eb7060dc55b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:41.350078 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4a344847-f8d5-4432-ba3c-4eb7060dc55b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:41.360831 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a344847-f8d5-4432-ba3c-4eb7060dc55b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:41.363288 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a344847-f8d5-4432-ba3c-4eb7060dc55b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:41.363804 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a344847-f8d5-4432-ba3c-4eb7060dc55b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:41.364698 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a344847-f8d5-4432-ba3c-4eb7060dc55b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:41.365167 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a344847-f8d5-4432-ba3c-4eb7060dc55b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:41.366352 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a344847-f8d5-4432-ba3c-4eb7060dc55b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:41.546509 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-110859d3-0cdf-42a2-8d96-82a2241a5a10 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:41.547278 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-110859d3-0cdf-42a2-8d96-82a2241a5a10 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:41.569157 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4a344847-f8d5-4432-ba3c-4eb7060dc55b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:41.589896 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4a344847-f8d5-4432-ba3c-4eb7060dc55b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:41.600627 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4a344847-f8d5-4432-ba3c-4eb7060dc55b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:41.607488 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4a344847-f8d5-4432-ba3c-4eb7060dc55b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1744 microversion: 2.20 time: 0.272316 Sep 27 16:38:41.609011 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 115/228] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:41 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1744 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:38:41.630028 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f3fa2169-1c96-4e55-9c3a-c0f86d1c6ac2 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:41.630726 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f3fa2169-1c96-4e55-9c3a-c0f86d1c6ac2 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:41.633333 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:41.643376 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3fa2169-1c96-4e55-9c3a-c0f86d1c6ac2 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:41.644085 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3fa2169-1c96-4e55-9c3a-c0f86d1c6ac2 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:41.648834 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3fa2169-1c96-4e55-9c3a-c0f86d1c6ac2 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:41.648834 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3fa2169-1c96-4e55-9c3a-c0f86d1c6ac2 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:41.657018 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3fa2169-1c96-4e55-9c3a-c0f86d1c6ac2 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:41.658203 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3fa2169-1c96-4e55-9c3a-c0f86d1c6ac2 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:41.729027 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-110859d3-0cdf-42a2-8d96-82a2241a5a10 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:41.742422 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-110859d3-0cdf-42a2-8d96-82a2241a5a10 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 200 len: 1219 microversion: 2.1 time: 0.205269 Sep 27 16:38:41.743467 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 114/229] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:41 2022] GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 1219 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:38:41.780772 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f3fa2169-1c96-4e55-9c3a-c0f86d1c6ac2 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:41.789493 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f3fa2169-1c96-4e55-9c3a-c0f86d1c6ac2 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 200 len: 1293 microversion: 2.1 time: 0.172108 Sep 27 16:38:41.790056 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 116/230] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:41 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 1293 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:41.952298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e7d540f9-d37e-4e57-845c-ebad9cca459b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:41.952927 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e7d540f9-d37e-4e57-845c-ebad9cca459b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:41.969650 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7d540f9-d37e-4e57-845c-ebad9cca459b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:41.970413 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7d540f9-d37e-4e57-845c-ebad9cca459b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:41.971090 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7d540f9-d37e-4e57-845c-ebad9cca459b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:41.972193 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7d540f9-d37e-4e57-845c-ebad9cca459b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:41.972763 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7d540f9-d37e-4e57-845c-ebad9cca459b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:41.973190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7d540f9-d37e-4e57-845c-ebad9cca459b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:42.061867 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-91ecf5da-6ac8-4bf4-be3b-76d327b5ec78 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:42.063400 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-91ecf5da-6ac8-4bf4-be3b-76d327b5ec78 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:42.070498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91ecf5da-6ac8-4bf4-be3b-76d327b5ec78 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:42.071291 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91ecf5da-6ac8-4bf4-be3b-76d327b5ec78 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:42.074269 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91ecf5da-6ac8-4bf4-be3b-76d327b5ec78 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:42.075306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91ecf5da-6ac8-4bf4-be3b-76d327b5ec78 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:42.076024 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91ecf5da-6ac8-4bf4-be3b-76d327b5ec78 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:42.076986 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91ecf5da-6ac8-4bf4-be3b-76d327b5ec78 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:42.158227 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91ecf5da-6ac8-4bf4-be3b-76d327b5ec78 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:42.159014 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91ecf5da-6ac8-4bf4-be3b-76d327b5ec78 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:42.161947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91ecf5da-6ac8-4bf4-be3b-76d327b5ec78 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:42.162850 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-91ecf5da-6ac8-4bf4-be3b-76d327b5ec78 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lazy-loading 'fault' on Instance uuid 6ad241be-370b-4cff-b34d-beea9d6842c5 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:38:42.320023 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-91ecf5da-6ac8-4bf4-be3b-76d327b5ec78 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:42.333528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-91ecf5da-6ac8-4bf4-be3b-76d327b5ec78 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5" status: 200 len: 1304 microversion: 2.1 time: 0.275972 Sep 27 16:38:42.336721 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 117/231] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:42 2022] GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 => generated 1304 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:42.375511 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e7d540f9-d37e-4e57-845c-ebad9cca459b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:42.386913 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e7d540f9-d37e-4e57-845c-ebad9cca459b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.437973 Sep 27 16:38:42.409469 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 115/232] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:41 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:42.526052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-281ed465-1f70-4b22-b447-60480ff5224b req-3ba7b5aa-60ed-4e1e-b866-58e45c91ac4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84acf37-9445-48cd-a921-12a7a3c301d9", "name": "network-vif-plugged", "status": "completed", "tag": "184e6faa-be62-4210-acc1-64aceea7f1f0"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:42.536594 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-281ed465-1f70-4b22-b447-60480ff5224b req-3ba7b5aa-60ed-4e1e-b866-58e45c91ac4c service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:42.537303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-281ed465-1f70-4b22-b447-60480ff5224b req-3ba7b5aa-60ed-4e1e-b866-58e45c91ac4c service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:42.537915 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-281ed465-1f70-4b22-b447-60480ff5224b req-3ba7b5aa-60ed-4e1e-b866-58e45c91ac4c service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:42.553482 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-281ed465-1f70-4b22-b447-60480ff5224b req-3ba7b5aa-60ed-4e1e-b866-58e45c91ac4c service nova] Creating event network-vif-plugged:184e6faa-be62-4210-acc1-64aceea7f1f0 for instance f84acf37-9445-48cd-a921-12a7a3c301d9 on hv-cinder-85506 Sep 27 16:38:42.560249 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-281ed465-1f70-4b22-b447-60480ff5224b req-3ba7b5aa-60ed-4e1e-b866-58e45c91ac4c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038786 Sep 27 16:38:42.561048 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 118/233] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:38:42.638377 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2096bf7d-312a-4487-8ca3-8326f7ebb08b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:42.639861 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2096bf7d-312a-4487-8ca3-8326f7ebb08b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:42.646660 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2096bf7d-312a-4487-8ca3-8326f7ebb08b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:42.648093 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2096bf7d-312a-4487-8ca3-8326f7ebb08b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:42.648940 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2096bf7d-312a-4487-8ca3-8326f7ebb08b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:42.649860 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2096bf7d-312a-4487-8ca3-8326f7ebb08b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:42.650619 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2096bf7d-312a-4487-8ca3-8326f7ebb08b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:42.651098 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2096bf7d-312a-4487-8ca3-8326f7ebb08b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:42.770564 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f99d2649-8f50-4d44-8674-4f5b9e830fc6 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:42.771873 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f99d2649-8f50-4d44-8674-4f5b9e830fc6 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:42.790767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f99d2649-8f50-4d44-8674-4f5b9e830fc6 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:42.794117 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f99d2649-8f50-4d44-8674-4f5b9e830fc6 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:42.795501 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f99d2649-8f50-4d44-8674-4f5b9e830fc6 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:42.796412 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f99d2649-8f50-4d44-8674-4f5b9e830fc6 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:42.799385 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f99d2649-8f50-4d44-8674-4f5b9e830fc6 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:42.800012 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f99d2649-8f50-4d44-8674-4f5b9e830fc6 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:42.977499 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f99d2649-8f50-4d44-8674-4f5b9e830fc6 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:42.987910 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f99d2649-8f50-4d44-8674-4f5b9e830fc6 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 200 len: 1215 microversion: 2.1 time: 0.222073 Sep 27 16:38:42.988803 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 119/234] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:42 2022] GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 1215 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:38:43.017488 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-336f7492-27d9-4205-a307-5d975f93c495 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:43.018376 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-336f7492-27d9-4205-a307-5d975f93c495 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:43.028208 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-336f7492-27d9-4205-a307-5d975f93c495 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:43.029101 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-336f7492-27d9-4205-a307-5d975f93c495 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:43.030561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-336f7492-27d9-4205-a307-5d975f93c495 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:43.031938 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-336f7492-27d9-4205-a307-5d975f93c495 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:43.033254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-336f7492-27d9-4205-a307-5d975f93c495 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:43.034289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-336f7492-27d9-4205-a307-5d975f93c495 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:43.059113 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2096bf7d-312a-4487-8ca3-8326f7ebb08b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:43.096051 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2096bf7d-312a-4487-8ca3-8326f7ebb08b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:43.097893 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2096bf7d-312a-4487-8ca3-8326f7ebb08b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:43.102164 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2096bf7d-312a-4487-8ca3-8326f7ebb08b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1739 microversion: 2.20 time: 0.471453 Sep 27 16:38:43.103899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 116/235] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:42 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1739 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:38:43.157888 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-336f7492-27d9-4205-a307-5d975f93c495 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:43.171723 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-336f7492-27d9-4205-a307-5d975f93c495 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 200 len: 1299 microversion: 2.1 time: 0.158113 Sep 27 16:38:43.173257 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 120/236] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:43 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 1299 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:43.364872 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8c809328-301d-4145-8e6a-584cc3233d2e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:43.365502 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8c809328-301d-4145-8e6a-584cc3233d2e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 6ad241be-370b-4cff-b34d-beea9d6842c5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:43.378697 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c809328-301d-4145-8e6a-584cc3233d2e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:43.379213 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c809328-301d-4145-8e6a-584cc3233d2e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:43.391574 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c809328-301d-4145-8e6a-584cc3233d2e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:43.395561 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c809328-301d-4145-8e6a-584cc3233d2e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:43.399292 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c809328-301d-4145-8e6a-584cc3233d2e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:43.417986 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c809328-301d-4145-8e6a-584cc3233d2e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:43.418194 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3b04dd94-68a8-4ac5-bbb2-cc96850d24ab tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:43.418194 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3b04dd94-68a8-4ac5-bbb2-cc96850d24ab tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:43.432754 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b04dd94-68a8-4ac5-bbb2-cc96850d24ab tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:43.469466 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b04dd94-68a8-4ac5-bbb2-cc96850d24ab tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:43.469466 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b04dd94-68a8-4ac5-bbb2-cc96850d24ab tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:43.469466 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b04dd94-68a8-4ac5-bbb2-cc96850d24ab tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:43.469466 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b04dd94-68a8-4ac5-bbb2-cc96850d24ab tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:43.472268 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b04dd94-68a8-4ac5-bbb2-cc96850d24ab tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:43.473710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-8c809328-301d-4145-8e6a-584cc3233d2e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] HTTP exception thrown: Instance 6ad241be-370b-4cff-b34d-beea9d6842c5 could not be found. Sep 27 16:38:43.473710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8c809328-301d-4145-8e6a-584cc3233d2e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Request method failure captured: Sep 27 16:38:43.473710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 HTTP/1.1 Sep 27 16:38:43.473710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:38:43.473710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:38:43.473710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:38:43.473710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 27 16:38:43.473710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:38:43.473710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:38:43.473710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:38:43.473710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:38:43.473710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMybx3wFLSk6UmXCwU0IFC8RvyHH7Rh_JbhieDC_mpSCTnVX9l1NK_LAing15GDusoprLdeeaA2JzPwnwpH6wABa3cycGO0I1SvN-aWTZGuxJq4B-E8vdMK1XLlxh5KHuSfKLnsFUTMYD7vPHooneJU3xEJvI-cStAhhA4lvNgOdBr6U Sep 27 16:38:43.473710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:38:43.473710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:38:43.473710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:38:43.473710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:38:43.473710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:38:43.473710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:38:43.473710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: 54a4b85dba3b48b68e25c190b98b6197 Sep 27 16:38:43.473710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesActionsTest-1202937359 Sep 27 16:38:43.473710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:38:43.473710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:38:43.477133 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/54a4b85dba3b48b68e25c190b98b6197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_54a4b85dba3b48b68e25c190b98b6197"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/54a4b85dba3b48b68e25c190b98b6197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/54a4b85dba3b48b68e25c190b98b6197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:38:43.477133 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesActionsTest-1202937359 Sep 27 16:38:43.477133 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 54a4b85dba3b48b68e25c190b98b6197 Sep 27 16:38:43.477133 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesActionsTest-1202937359 Sep 27 16:38:43.477133 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesActionsTest-1202937359-project Sep 27 16:38:43.477133 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:38:43.477133 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:38:43.477133 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: f7e32dbc314d4953b3e3c21cbb481367 Sep 27 16:38:43.477133 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesActionsTest-1202937359-project Sep 27 16:38:43.477133 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: > Sep 27 16:38:43.477133 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Instance 6ad241be-370b-4cff-b34d-beea9d6842c5 could not be found. Sep 27 16:38:43.477133 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'id': '6ad241be-370b-4cff-b34d-beea9d6842c5'} Sep 27 16:38:43.478756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:38:43.478756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:38:43.478756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:38:43.478756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:38:43.478756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:38:43.478756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:38:43.478756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:38:43.478756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:38:43.478756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:38:43.478756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:38:43.478756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ad241be-370b-4cff-b34d-beea9d6842c5 could not be found. Sep 27 16:38:43.478756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:38:43.478756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:38:43.478756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:38:43.478756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:38:43.478756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:38:43.478756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:38:43.478756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:38:43.478756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:38:43.478756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:38:43.490979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:38:43.490979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:38:43.490979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:38:43.490979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:38:43.490979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:38:43.490979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:38:43.490979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:38:43.490979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ad241be-370b-4cff-b34d-beea9d6842c5 could not be found. Sep 27 16:38:43.490979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:38:43.490979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:38:43.490979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:38:43.490979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:38:43.490979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:38:43.490979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:38:43.490979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:38:43.490979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:38:43.490979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ad241be-370b-4cff-b34d-beea9d6842c5 could not be found. Sep 27 16:38:43.490979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:38:43.492523 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8c809328-301d-4145-8e6a-584cc3233d2e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Returning 404 to user: Instance 6ad241be-370b-4cff-b34d-beea9d6842c5 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:38:43.492523 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8c809328-301d-4145-8e6a-584cc3233d2e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5" status: 404 len: 111 microversion: 2.1 time: 0.116194 Sep 27 16:38:43.492523 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 117/237] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:43 2022] GET /compute/v2.1/servers/6ad241be-370b-4cff-b34d-beea9d6842c5 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:38:43.835670 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3b04dd94-68a8-4ac5-bbb2-cc96850d24ab tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:43.845587 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3b04dd94-68a8-4ac5-bbb2-cc96850d24ab tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.434345 Sep 27 16:38:43.854903 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 121/238] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:43 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:43.876523 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-60aa3751-2097-4d59-9f5c-2ed63dc6fdeb tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-14118573", "imageRef": "6908a343-46fa-4801-bfb5-7ad92ac26956", "flavorRef": "452", "networks": [{"uuid": "842f602d-43b0-47fc-8317-0141848ffd1d"}]}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:44.019345 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bb885208-785e-406d-aff2-70c1f8e0abc3 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:44.020414 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bb885208-785e-406d-aff2-70c1f8e0abc3 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:44.032673 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb885208-785e-406d-aff2-70c1f8e0abc3 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:44.033548 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb885208-785e-406d-aff2-70c1f8e0abc3 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:44.033986 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb885208-785e-406d-aff2-70c1f8e0abc3 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:44.034917 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb885208-785e-406d-aff2-70c1f8e0abc3 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:44.035773 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb885208-785e-406d-aff2-70c1f8e0abc3 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:44.036462 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb885208-785e-406d-aff2-70c1f8e0abc3 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:44.101312 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bb885208-785e-406d-aff2-70c1f8e0abc3 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:44.112916 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bb885208-785e-406d-aff2-70c1f8e0abc3 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 200 len: 1271 microversion: 2.1 time: 0.101326 Sep 27 16:38:44.113605 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 122/239] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:44 2022] GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:44.133096 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-70563402-9eff-4ac7-b78a-0d25d253c0ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:44.133707 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-70563402-9eff-4ac7-b78a-0d25d253c0ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:44.140340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70563402-9eff-4ac7-b78a-0d25d253c0ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:44.140829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70563402-9eff-4ac7-b78a-0d25d253c0ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:44.141337 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70563402-9eff-4ac7-b78a-0d25d253c0ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:44.142039 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70563402-9eff-4ac7-b78a-0d25d253c0ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:44.142722 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70563402-9eff-4ac7-b78a-0d25d253c0ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:44.143320 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70563402-9eff-4ac7-b78a-0d25d253c0ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:44.317679 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-70563402-9eff-4ac7-b78a-0d25d253c0ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:44.334191 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-70563402-9eff-4ac7-b78a-0d25d253c0ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:44.336217 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-70563402-9eff-4ac7-b78a-0d25d253c0ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:44.352402 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-70563402-9eff-4ac7-b78a-0d25d253c0ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1739 microversion: 2.20 time: 0.223025 Sep 27 16:38:44.358430 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 123/240] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:44 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:38:44.363153 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ae3f9650-2716-4d4b-b83e-035d09fab154 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:44.363815 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ae3f9650-2716-4d4b-b83e-035d09fab154 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:44.378829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae3f9650-2716-4d4b-b83e-035d09fab154 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:44.383623 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae3f9650-2716-4d4b-b83e-035d09fab154 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:44.383623 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae3f9650-2716-4d4b-b83e-035d09fab154 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:44.383623 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae3f9650-2716-4d4b-b83e-035d09fab154 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:44.383623 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae3f9650-2716-4d4b-b83e-035d09fab154 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:44.384057 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae3f9650-2716-4d4b-b83e-035d09fab154 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:44.922013 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ae3f9650-2716-4d4b-b83e-035d09fab154 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:44.935992 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ae3f9650-2716-4d4b-b83e-035d09fab154 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 200 len: 1367 microversion: 2.1 time: 0.579251 Sep 27 16:38:44.938817 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 124/241] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:44 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 1367 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:44.953214 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-63ce4334-2c0e-4fa9-b4cf-17e28d9b42fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:44.954651 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-63ce4334-2c0e-4fa9-b4cf-17e28d9b42fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:44.970321 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63ce4334-2c0e-4fa9-b4cf-17e28d9b42fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:44.971137 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63ce4334-2c0e-4fa9-b4cf-17e28d9b42fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:44.973364 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63ce4334-2c0e-4fa9-b4cf-17e28d9b42fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:44.974275 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63ce4334-2c0e-4fa9-b4cf-17e28d9b42fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:44.978165 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63ce4334-2c0e-4fa9-b4cf-17e28d9b42fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:44.980241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63ce4334-2c0e-4fa9-b4cf-17e28d9b42fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:45.255380 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-63ce4334-2c0e-4fa9-b4cf-17e28d9b42fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:45.265391 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-63ce4334-2c0e-4fa9-b4cf-17e28d9b42fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.325348 Sep 27 16:38:45.287211 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 125/242] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:44 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:45.303296 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b9816d63-7d69-489f-a397-6794f4ed01a1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:45.304201 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b9816d63-7d69-489f-a397-6794f4ed01a1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:45.314075 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b9816d63-7d69-489f-a397-6794f4ed01a1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:45.324290 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b9816d63-7d69-489f-a397-6794f4ed01a1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:45.325084 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b9816d63-7d69-489f-a397-6794f4ed01a1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:45.326100 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b9816d63-7d69-489f-a397-6794f4ed01a1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:45.326800 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b9816d63-7d69-489f-a397-6794f4ed01a1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:45.327428 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b9816d63-7d69-489f-a397-6794f4ed01a1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:45.514164 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b9816d63-7d69-489f-a397-6794f4ed01a1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:45.526988 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b9816d63-7d69-489f-a397-6794f4ed01a1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 200 len: 1277 microversion: 2.1 time: 0.238264 Sep 27 16:38:45.527607 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 126/243] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:45 2022] GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 1277 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:45.537110 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d236076e-92d1-49ea-b44d-51da6950d7b7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:45.543000 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d236076e-92d1-49ea-b44d-51da6950d7b7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:45.552974 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d236076e-92d1-49ea-b44d-51da6950d7b7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:45.553662 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d236076e-92d1-49ea-b44d-51da6950d7b7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:45.554303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d236076e-92d1-49ea-b44d-51da6950d7b7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:45.555208 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d236076e-92d1-49ea-b44d-51da6950d7b7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:45.555820 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d236076e-92d1-49ea-b44d-51da6950d7b7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:45.556946 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d236076e-92d1-49ea-b44d-51da6950d7b7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:45.847178 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d236076e-92d1-49ea-b44d-51da6950d7b7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:45.862856 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d236076e-92d1-49ea-b44d-51da6950d7b7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:45.864755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d236076e-92d1-49ea-b44d-51da6950d7b7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:45.870148 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d236076e-92d1-49ea-b44d-51da6950d7b7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1739 microversion: 2.20 time: 0.334516 Sep 27 16:38:45.886133 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 127/244] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:45 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1739 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:38:45.964652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f3326a5d-1b99-4a10-a456-8058d0a323a8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:45.965350 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f3326a5d-1b99-4a10-a456-8058d0a323a8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:45.974729 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3326a5d-1b99-4a10-a456-8058d0a323a8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:45.976403 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3326a5d-1b99-4a10-a456-8058d0a323a8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:45.976849 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3326a5d-1b99-4a10-a456-8058d0a323a8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:45.978968 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3326a5d-1b99-4a10-a456-8058d0a323a8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:45.979541 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3326a5d-1b99-4a10-a456-8058d0a323a8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:45.983328 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3326a5d-1b99-4a10-a456-8058d0a323a8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:46.020243 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:46.255781 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f3326a5d-1b99-4a10-a456-8058d0a323a8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:46.266376 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f3326a5d-1b99-4a10-a456-8058d0a323a8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 200 len: 1367 microversion: 2.1 time: 0.305738 Sep 27 16:38:46.269290 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 128/245] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:45 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:38:46.280223 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-011a7830-b405-4ca3-b69c-58b550713c9c tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Action: 'create', calling method: .version_select at 0x7fa405a89a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-221901116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZTmmc1xO3CDv6ZH2MMzNlb6m/M17AyEw5MnIv+QuxEb+KIdPeThRUMAZqgXkXShAERUZ/o2LHj+S2YpLM/zRcPSDe+T6IFAFC1SAZJWdPIIYyg35U6Om77wI8/VYTSfg=="}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:46.307405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-011a7830-b405-4ca3-b69c-58b550713c9c tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Getting quotas for project d5fb5144fbf64abe8ec6b37c7f0444b3. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:38:46.313200 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-011a7830-b405-4ca3-b69c-58b550713c9c tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Getting quotas for user 978e8037ce1d4742abe66ea12d660479 and project d5fb5144fbf64abe8ec6b37c7f0444b3. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:38:46.338109 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-60aa3751-2097-4d59-9f5c-2ed63dc6fdeb tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] validate_networks() for [('842f602d-43b0-47fc-8317-0141848ffd1d', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 16:38:46.456213 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-011a7830-b405-4ca3-b69c-58b550713c9c tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.179837 Sep 27 16:38:46.456213 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 129/246] 10.222.0.64 () {60 vars in 1159 bytes} [Tue Sep 27 16:38:46 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:38:46.473254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-9e7fbf14-ee6a-41c1-8efe-7608b8625cda req-b51c6bd9-1e94-4b21-984f-7b2ee9e5f24f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2bb023b-8f1e-4e58-969b-e6c56395acca", "tag": "2cce0dbb-eb5a-403b-b124-6df0f04b0136"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:46.503146 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-9e7fbf14-ee6a-41c1-8efe-7608b8625cda req-b51c6bd9-1e94-4b21-984f-7b2ee9e5f24f service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:46.503645 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-9e7fbf14-ee6a-41c1-8efe-7608b8625cda req-b51c6bd9-1e94-4b21-984f-7b2ee9e5f24f service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:46.504080 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-9e7fbf14-ee6a-41c1-8efe-7608b8625cda req-b51c6bd9-1e94-4b21-984f-7b2ee9e5f24f service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:46.527375 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-9e7fbf14-ee6a-41c1-8efe-7608b8625cda req-b51c6bd9-1e94-4b21-984f-7b2ee9e5f24f service nova] Creating event network-changed:2cce0dbb-eb5a-403b-b124-6df0f04b0136 for instance c2bb023b-8f1e-4e58-969b-e6c56395acca on hv-cinder-85506 Sep 27 16:38:46.537354 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-9e7fbf14-ee6a-41c1-8efe-7608b8625cda req-b51c6bd9-1e94-4b21-984f-7b2ee9e5f24f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066418 Sep 27 16:38:46.544503 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 130/247] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:38:46.563948 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-280b3af5-e7cd-481d-8883-1c11b9fc1524 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:46.568204 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-280b3af5-e7cd-481d-8883-1c11b9fc1524 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:46.583920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-280b3af5-e7cd-481d-8883-1c11b9fc1524 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:46.584990 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-280b3af5-e7cd-481d-8883-1c11b9fc1524 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:46.585595 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-280b3af5-e7cd-481d-8883-1c11b9fc1524 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:46.587600 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-280b3af5-e7cd-481d-8883-1c11b9fc1524 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:46.588512 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-280b3af5-e7cd-481d-8883-1c11b9fc1524 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:46.592383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-280b3af5-e7cd-481d-8883-1c11b9fc1524 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:46.878031 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-280b3af5-e7cd-481d-8883-1c11b9fc1524 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:46.895096 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-280b3af5-e7cd-481d-8883-1c11b9fc1524 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.348557 Sep 27 16:38:46.898500 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 131/248] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:46 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:46.908751 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-69fdb000-590d-42e2-82e5-bf387ac729e8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:46.909602 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-69fdb000-590d-42e2-82e5-bf387ac729e8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:46.928171 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69fdb000-590d-42e2-82e5-bf387ac729e8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:46.929133 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69fdb000-590d-42e2-82e5-bf387ac729e8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:46.929803 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69fdb000-590d-42e2-82e5-bf387ac729e8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:46.930794 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69fdb000-590d-42e2-82e5-bf387ac729e8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:46.931446 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69fdb000-590d-42e2-82e5-bf387ac729e8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:46.932694 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69fdb000-590d-42e2-82e5-bf387ac729e8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:47.208172 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-60aa3751-2097-4d59-9f5c-2ed63dc6fdeb tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 16:38:47.210168 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-60aa3751-2097-4d59-9f5c-2ed63dc6fdeb tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 16:38:47.212303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-60aa3751-2097-4d59-9f5c-2ed63dc6fdeb tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 16:38:47.213641 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-60aa3751-2097-4d59-9f5c-2ed63dc6fdeb tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 16:38:47.214159 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-60aa3751-2097-4d59-9f5c-2ed63dc6fdeb tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 16:38:47.216077 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-69fdb000-590d-42e2-82e5-bf387ac729e8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:47.223754 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-69fdb000-590d-42e2-82e5-bf387ac729e8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 200 len: 1319 microversion: 2.1 time: 0.325669 Sep 27 16:38:47.224028 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60aa3751-2097-4d59-9f5c-2ed63dc6fdeb tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:47.224341 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 132/249] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:46 2022] GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:47.224966 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60aa3751-2097-4d59-9f5c-2ed63dc6fdeb tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:47.225635 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60aa3751-2097-4d59-9f5c-2ed63dc6fdeb tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:47.226467 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60aa3751-2097-4d59-9f5c-2ed63dc6fdeb tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:47.227037 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60aa3751-2097-4d59-9f5c-2ed63dc6fdeb tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:47.227692 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60aa3751-2097-4d59-9f5c-2ed63dc6fdeb tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:47.231465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4e41bd94-b369-4ac3-8e06-a7861dab0297 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1826274544", "imageRef": "ca826451-0699-435a-8574-512e245941de", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-221901116", "networks": [{"uuid": "4bea8f32-9dee-4e9e-acbd-2c1c4f93e5ae"}]}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:47.252486 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-60aa3751-2097-4d59-9f5c-2ed63dc6fdeb tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Getting quotas for project 54a4b85dba3b48b68e25c190b98b6197. Resources: {'instances', 'ram', 'cores'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:38:47.268120 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-60aa3751-2097-4d59-9f5c-2ed63dc6fdeb tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Getting quotas for user f7e32dbc314d4953b3e3c21cbb481367 and project 54a4b85dba3b48b68e25c190b98b6197. Resources: {'instances', 'ram', 'cores'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:38:47.282602 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-60aa3751-2097-4d59-9f5c-2ed63dc6fdeb tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 16:38:47.287770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-60aa3751-2097-4d59-9f5c-2ed63dc6fdeb tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6908a343-46fa-4801-bfb5-7ad92ac26956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 16:38:47.300951 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-4e41bd94-b369-4ac3-8e06-a7861dab0297 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] validate_networks() for [('4bea8f32-9dee-4e9e-acbd-2c1c4f93e5ae', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 16:38:47.483553 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-60aa3751-2097-4d59-9f5c-2ed63dc6fdeb tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.610880 Sep 27 16:38:47.485715 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 118/250] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Sep 27 16:38:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 16:38:47.514621 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-013d140b-5c96-4d72-a281-dabfa05e5be6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:47.530342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-013d140b-5c96-4d72-a281-dabfa05e5be6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:47.537012 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-013d140b-5c96-4d72-a281-dabfa05e5be6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:47.537732 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-013d140b-5c96-4d72-a281-dabfa05e5be6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:47.538167 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-013d140b-5c96-4d72-a281-dabfa05e5be6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:47.538902 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-013d140b-5c96-4d72-a281-dabfa05e5be6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:47.540178 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-013d140b-5c96-4d72-a281-dabfa05e5be6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:47.540808 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-013d140b-5c96-4d72-a281-dabfa05e5be6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:48.101060 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-013d140b-5c96-4d72-a281-dabfa05e5be6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:48.114053 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-013d140b-5c96-4d72-a281-dabfa05e5be6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:48.117962 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-013d140b-5c96-4d72-a281-dabfa05e5be6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:48.121288 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-013d140b-5c96-4d72-a281-dabfa05e5be6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1739 microversion: 2.20 time: 0.633323 Sep 27 16:38:48.143599 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 119/251] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:47 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1739 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:38:48.152257 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d17b9be6-4f93-40f9-bbe0-b783b8ce38d9 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:48.152940 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d17b9be6-4f93-40f9-bbe0-b783b8ce38d9 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:48.164281 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d17b9be6-4f93-40f9-bbe0-b783b8ce38d9 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:48.164778 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d17b9be6-4f93-40f9-bbe0-b783b8ce38d9 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:48.165229 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d17b9be6-4f93-40f9-bbe0-b783b8ce38d9 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:48.172052 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d17b9be6-4f93-40f9-bbe0-b783b8ce38d9 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:48.173004 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d17b9be6-4f93-40f9-bbe0-b783b8ce38d9 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:48.174364 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d17b9be6-4f93-40f9-bbe0-b783b8ce38d9 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:48.327937 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:48.680343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d17b9be6-4f93-40f9-bbe0-b783b8ce38d9 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:48.694759 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d17b9be6-4f93-40f9-bbe0-b783b8ce38d9 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 200 len: 1367 microversion: 2.1 time: 0.548118 Sep 27 16:38:48.695720 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 120/252] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:48 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 1367 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:48.704246 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fd96bfdc-b572-4c21-bf0e-19473b610bbf tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:48.708963 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fd96bfdc-b572-4c21-bf0e-19473b610bbf tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:48.714670 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-4e41bd94-b369-4ac3-8e06-a7861dab0297 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 16:38:48.715331 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-4e41bd94-b369-4ac3-8e06-a7861dab0297 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 16:38:48.716035 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-4e41bd94-b369-4ac3-8e06-a7861dab0297 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 16:38:48.716605 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-4e41bd94-b369-4ac3-8e06-a7861dab0297 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 16:38:48.717221 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-4e41bd94-b369-4ac3-8e06-a7861dab0297 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 16:38:48.723807 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fd96bfdc-b572-4c21-bf0e-19473b610bbf tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:48.724664 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fd96bfdc-b572-4c21-bf0e-19473b610bbf tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:48.726388 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fd96bfdc-b572-4c21-bf0e-19473b610bbf tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:48.728298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fd96bfdc-b572-4c21-bf0e-19473b610bbf tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:48.731397 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fd96bfdc-b572-4c21-bf0e-19473b610bbf tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:48.732242 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fd96bfdc-b572-4c21-bf0e-19473b610bbf tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:48.737682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e41bd94-b369-4ac3-8e06-a7861dab0297 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:48.737682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e41bd94-b369-4ac3-8e06-a7861dab0297 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:48.737682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e41bd94-b369-4ac3-8e06-a7861dab0297 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:48.737682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e41bd94-b369-4ac3-8e06-a7861dab0297 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:48.738070 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e41bd94-b369-4ac3-8e06-a7861dab0297 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:48.738070 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e41bd94-b369-4ac3-8e06-a7861dab0297 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:48.776543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-4e41bd94-b369-4ac3-8e06-a7861dab0297 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Getting quotas for project d5fb5144fbf64abe8ec6b37c7f0444b3. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:38:48.781792 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-4e41bd94-b369-4ac3-8e06-a7861dab0297 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Getting quotas for user 978e8037ce1d4742abe66ea12d660479 and project d5fb5144fbf64abe8ec6b37c7f0444b3. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:38:48.798157 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4e41bd94-b369-4ac3-8e06-a7861dab0297 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 16:38:48.800731 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4e41bd94-b369-4ac3-8e06-a7861dab0297 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca826451-0699-435a-8574-512e245941de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 16:38:48.839113 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fd96bfdc-b572-4c21-bf0e-19473b610bbf tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:48.847641 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fd96bfdc-b572-4c21-bf0e-19473b610bbf tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 200 len: 1216 microversion: 2.1 time: 0.148593 Sep 27 16:38:48.848528 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 121/253] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:48 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 1216 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:48.853946 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-31c31c4a-4af9-4843-9b75-af0a5e30986c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:48.854731 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-31c31c4a-4af9-4843-9b75-af0a5e30986c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:48.870275 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31c31c4a-4af9-4843-9b75-af0a5e30986c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:48.875235 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31c31c4a-4af9-4843-9b75-af0a5e30986c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:48.875914 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31c31c4a-4af9-4843-9b75-af0a5e30986c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:48.876863 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31c31c4a-4af9-4843-9b75-af0a5e30986c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:48.877583 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31c31c4a-4af9-4843-9b75-af0a5e30986c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:48.892094 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31c31c4a-4af9-4843-9b75-af0a5e30986c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:48.957567 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4e41bd94-b369-4ac3-8e06-a7861dab0297 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.731644 Sep 27 16:38:48.958219 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 133/254] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Sep 27 16:38:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 16:38:48.966518 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e6bf68b8-5aa4-471f-8ba9-088460361707 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:48.967925 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e6bf68b8-5aa4-471f-8ba9-088460361707 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:48.980138 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6bf68b8-5aa4-471f-8ba9-088460361707 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:48.980138 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6bf68b8-5aa4-471f-8ba9-088460361707 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:48.980138 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6bf68b8-5aa4-471f-8ba9-088460361707 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:48.980138 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6bf68b8-5aa4-471f-8ba9-088460361707 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:48.980551 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6bf68b8-5aa4-471f-8ba9-088460361707 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:48.980551 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6bf68b8-5aa4-471f-8ba9-088460361707 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:49.243688 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-31c31c4a-4af9-4843-9b75-af0a5e30986c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:49.261072 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-31c31c4a-4af9-4843-9b75-af0a5e30986c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1522 microversion: 2.1 time: 0.409987 Sep 27 16:38:49.277549 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 122/255] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:48 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:49.280366 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0f611212-6552-4f0f-9f61-4f7a5652b9d8 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:49.283355 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0f611212-6552-4f0f-9f61-4f7a5652b9d8 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:49.331247 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e6bf68b8-5aa4-471f-8ba9-088460361707 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:49.351336 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e6bf68b8-5aa4-471f-8ba9-088460361707 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 200 len: 1319 microversion: 2.1 time: 0.390731 Sep 27 16:38:49.356939 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 134/256] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:48 2022] GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 1319 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:49.365368 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f4c045bd-a1f9-41b0-8a25-67a51d41c675 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:49.369446 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f4c045bd-a1f9-41b0-8a25-67a51d41c675 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:49.377435 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f4c045bd-a1f9-41b0-8a25-67a51d41c675 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:49.378179 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f4c045bd-a1f9-41b0-8a25-67a51d41c675 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:49.379286 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f4c045bd-a1f9-41b0-8a25-67a51d41c675 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:49.380307 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f4c045bd-a1f9-41b0-8a25-67a51d41c675 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:49.381019 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f4c045bd-a1f9-41b0-8a25-67a51d41c675 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:49.381652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f4c045bd-a1f9-41b0-8a25-67a51d41c675 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:49.381764 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0f611212-6552-4f0f-9f61-4f7a5652b9d8 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:49.396591 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0f611212-6552-4f0f-9f61-4f7a5652b9d8 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1258 microversion: 2.1 time: 0.124381 Sep 27 16:38:49.407171 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 123/257] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:49 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1258 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:49.687138 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f4c045bd-a1f9-41b0-8a25-67a51d41c675 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:49.696503 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f4c045bd-a1f9-41b0-8a25-67a51d41c675 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:49.698318 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f4c045bd-a1f9-41b0-8a25-67a51d41c675 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:49.699522 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f4c045bd-a1f9-41b0-8a25-67a51d41c675 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1739 microversion: 2.20 time: 0.341240 Sep 27 16:38:49.700258 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 135/258] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:49 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1739 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:38:49.719582 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-db91215f-ed82-4aa4-bf79-2a84aecf170c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:49.720345 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-db91215f-ed82-4aa4-bf79-2a84aecf170c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:49.727002 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db91215f-ed82-4aa4-bf79-2a84aecf170c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:49.727690 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db91215f-ed82-4aa4-bf79-2a84aecf170c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:49.729759 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db91215f-ed82-4aa4-bf79-2a84aecf170c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:49.732044 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db91215f-ed82-4aa4-bf79-2a84aecf170c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:49.732674 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db91215f-ed82-4aa4-bf79-2a84aecf170c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:49.733253 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db91215f-ed82-4aa4-bf79-2a84aecf170c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:49.844163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-195e886b-7438-4178-a986-14dfb42707bc req-3a9f0677-55aa-481c-a9b6-78045297fe94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab77e6d5-1c27-420a-b7cd-b32c4f418dab", "tag": "b076a24a-f4ef-4eb2-b560-505f54ef1e3d"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:49.858041 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-195e886b-7438-4178-a986-14dfb42707bc req-3a9f0677-55aa-481c-a9b6-78045297fe94 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:49.859563 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-195e886b-7438-4178-a986-14dfb42707bc req-3a9f0677-55aa-481c-a9b6-78045297fe94 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:49.860222 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-195e886b-7438-4178-a986-14dfb42707bc req-3a9f0677-55aa-481c-a9b6-78045297fe94 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:49.885949 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-195e886b-7438-4178-a986-14dfb42707bc req-3a9f0677-55aa-481c-a9b6-78045297fe94 service nova] Creating event network-changed:b076a24a-f4ef-4eb2-b560-505f54ef1e3d for instance ab77e6d5-1c27-420a-b7cd-b32c4f418dab on hv-cinder-85506 Sep 27 16:38:49.900652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-195e886b-7438-4178-a986-14dfb42707bc req-3a9f0677-55aa-481c-a9b6-78045297fe94 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059999 Sep 27 16:38:49.902253 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 136/259] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:38:49.912475 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f63b1f20-e3c1-466e-8cd7-9cb4694940e6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:49.920216 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f63b1f20-e3c1-466e-8cd7-9cb4694940e6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:49.930837 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f63b1f20-e3c1-466e-8cd7-9cb4694940e6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:49.932533 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f63b1f20-e3c1-466e-8cd7-9cb4694940e6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:49.933283 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f63b1f20-e3c1-466e-8cd7-9cb4694940e6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:49.934157 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f63b1f20-e3c1-466e-8cd7-9cb4694940e6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:49.934810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f63b1f20-e3c1-466e-8cd7-9cb4694940e6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:49.935381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f63b1f20-e3c1-466e-8cd7-9cb4694940e6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:50.006940 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-db91215f-ed82-4aa4-bf79-2a84aecf170c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:50.019942 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-db91215f-ed82-4aa4-bf79-2a84aecf170c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 200 len: 1367 microversion: 2.1 time: 0.304180 Sep 27 16:38:50.021149 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 124/260] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:49 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:50.033665 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f63b1f20-e3c1-466e-8cd7-9cb4694940e6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:50.045258 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f63b1f20-e3c1-466e-8cd7-9cb4694940e6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 200 len: 1216 microversion: 2.1 time: 0.141305 Sep 27 16:38:50.045847 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 137/261] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:49 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 1216 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:50.287478 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-26006870-fff4-4b2f-a50f-75a4b81a25e5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:50.288103 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-26006870-fff4-4b2f-a50f-75a4b81a25e5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:50.311602 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26006870-fff4-4b2f-a50f-75a4b81a25e5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:50.314988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26006870-fff4-4b2f-a50f-75a4b81a25e5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:50.317376 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26006870-fff4-4b2f-a50f-75a4b81a25e5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:50.318235 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26006870-fff4-4b2f-a50f-75a4b81a25e5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:50.319773 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26006870-fff4-4b2f-a50f-75a4b81a25e5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:50.320687 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26006870-fff4-4b2f-a50f-75a4b81a25e5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:50.357023 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:50.383885 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0c2e6632-8213-40a4-b76c-99adc6acd42a tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:50.385462 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0c2e6632-8213-40a4-b76c-99adc6acd42a tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:50.411615 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c2e6632-8213-40a4-b76c-99adc6acd42a tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:50.417411 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c2e6632-8213-40a4-b76c-99adc6acd42a tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:50.418158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c2e6632-8213-40a4-b76c-99adc6acd42a tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:50.420097 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c2e6632-8213-40a4-b76c-99adc6acd42a tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:50.425974 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c2e6632-8213-40a4-b76c-99adc6acd42a tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:50.426713 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c2e6632-8213-40a4-b76c-99adc6acd42a tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:50.776499 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-26006870-fff4-4b2f-a50f-75a4b81a25e5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:50.792601 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-26006870-fff4-4b2f-a50f-75a4b81a25e5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1502 microversion: 2.1 time: 0.507864 Sep 27 16:38:50.804478 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 125/262] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:50 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1502 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:50.828004 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0a123909-84b3-4b1e-801f-9aa2e2f57d4f tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:50.828004 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0a123909-84b3-4b1e-801f-9aa2e2f57d4f tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:50.828004 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0a123909-84b3-4b1e-801f-9aa2e2f57d4f tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:50.831191 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0a123909-84b3-4b1e-801f-9aa2e2f57d4f tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:50.832167 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0a123909-84b3-4b1e-801f-9aa2e2f57d4f tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:50.838217 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0a123909-84b3-4b1e-801f-9aa2e2f57d4f tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:50.840636 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0a123909-84b3-4b1e-801f-9aa2e2f57d4f tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:50.841419 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0a123909-84b3-4b1e-801f-9aa2e2f57d4f tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:50.971000 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0c2e6632-8213-40a4-b76c-99adc6acd42a tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:50.982103 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0c2e6632-8213-40a4-b76c-99adc6acd42a tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 200 len: 1319 microversion: 2.1 time: 0.600171 Sep 27 16:38:50.988669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0a123909-84b3-4b1e-801f-9aa2e2f57d4f tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:50.992538 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 138/263] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:50 2022] GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 1319 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:38:51.000325 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0a123909-84b3-4b1e-801f-9aa2e2f57d4f tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1262 microversion: 2.1 time: 0.194189 Sep 27 16:38:51.003237 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 126/264] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:50 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1262 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:51.011107 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3c67cd1c-0c1e-4540-b186-258857d69929 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:51.011107 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3c67cd1c-0c1e-4540-b186-258857d69929 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:51.013900 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a4dac34b-4aac-4681-b2cc-cf6139a16c88 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:51.020851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a4dac34b-4aac-4681-b2cc-cf6139a16c88 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:51.029659 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c67cd1c-0c1e-4540-b186-258857d69929 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:51.032267 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c67cd1c-0c1e-4540-b186-258857d69929 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:51.032825 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c67cd1c-0c1e-4540-b186-258857d69929 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:51.034671 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c67cd1c-0c1e-4540-b186-258857d69929 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:51.036749 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c67cd1c-0c1e-4540-b186-258857d69929 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:51.036987 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4dac34b-4aac-4681-b2cc-cf6139a16c88 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:51.037350 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c67cd1c-0c1e-4540-b186-258857d69929 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:51.039546 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4dac34b-4aac-4681-b2cc-cf6139a16c88 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:51.045939 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4dac34b-4aac-4681-b2cc-cf6139a16c88 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:51.045939 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4dac34b-4aac-4681-b2cc-cf6139a16c88 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:51.045939 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4dac34b-4aac-4681-b2cc-cf6139a16c88 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:51.045939 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4dac34b-4aac-4681-b2cc-cf6139a16c88 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:51.507379 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3c67cd1c-0c1e-4540-b186-258857d69929 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:51.519090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3c67cd1c-0c1e-4540-b186-258857d69929 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:51.532718 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3c67cd1c-0c1e-4540-b186-258857d69929 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:51.534400 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3c67cd1c-0c1e-4540-b186-258857d69929 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1739 microversion: 2.20 time: 0.540640 Sep 27 16:38:51.535459 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 139/265] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:50 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1739 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:38:51.540135 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-92888e96-eca0-498a-82e4-644366c64cbf tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:51.542450 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-92888e96-eca0-498a-82e4-644366c64cbf tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:51.558313 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a4dac34b-4aac-4681-b2cc-cf6139a16c88 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:51.570543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92888e96-eca0-498a-82e4-644366c64cbf tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:51.570543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92888e96-eca0-498a-82e4-644366c64cbf tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:51.570543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92888e96-eca0-498a-82e4-644366c64cbf tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:51.570543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92888e96-eca0-498a-82e4-644366c64cbf tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:51.573030 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a4dac34b-4aac-4681-b2cc-cf6139a16c88 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1517 microversion: 2.1 time: 0.562809 Sep 27 16:38:51.574285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92888e96-eca0-498a-82e4-644366c64cbf tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:51.575069 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 127/266] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:51 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1517 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:51.576212 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92888e96-eca0-498a-82e4-644366c64cbf tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:51.583152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-97e9fec0-a092-42e8-92dc-173709460869 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:51.583968 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-97e9fec0-a092-42e8-92dc-173709460869 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:51.610251 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97e9fec0-a092-42e8-92dc-173709460869 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:51.610756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97e9fec0-a092-42e8-92dc-173709460869 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:51.611220 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97e9fec0-a092-42e8-92dc-173709460869 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:51.611931 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97e9fec0-a092-42e8-92dc-173709460869 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:51.612386 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97e9fec0-a092-42e8-92dc-173709460869 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:51.612809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97e9fec0-a092-42e8-92dc-173709460869 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:51.739531 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-97e9fec0-a092-42e8-92dc-173709460869 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:51.755468 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-97e9fec0-a092-42e8-92dc-173709460869 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 200 len: 1264 microversion: 2.1 time: 0.179058 Sep 27 16:38:51.756695 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 128/267] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:51 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:51.905176 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-92888e96-eca0-498a-82e4-644366c64cbf tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:51.920207 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-92888e96-eca0-498a-82e4-644366c64cbf tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 200 len: 1367 microversion: 2.1 time: 0.382352 Sep 27 16:38:51.923812 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 140/268] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:51 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 1367 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:52.007660 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-010ce1b1-1116-466d-9c7e-21e7f25d9d5f tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:52.009783 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-010ce1b1-1116-466d-9c7e-21e7f25d9d5f tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:52.016673 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-010ce1b1-1116-466d-9c7e-21e7f25d9d5f tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:52.020031 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-010ce1b1-1116-466d-9c7e-21e7f25d9d5f tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:52.020031 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-010ce1b1-1116-466d-9c7e-21e7f25d9d5f tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:52.020031 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-010ce1b1-1116-466d-9c7e-21e7f25d9d5f tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:52.020031 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-010ce1b1-1116-466d-9c7e-21e7f25d9d5f tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:52.021012 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-010ce1b1-1116-466d-9c7e-21e7f25d9d5f tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:52.038595 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c143a49a-005d-4e24-a739-5f901445d06b tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:52.039799 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c143a49a-005d-4e24-a739-5f901445d06b tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:52.058711 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c143a49a-005d-4e24-a739-5f901445d06b tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:52.060382 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c143a49a-005d-4e24-a739-5f901445d06b tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:52.061066 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c143a49a-005d-4e24-a739-5f901445d06b tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:52.063052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c143a49a-005d-4e24-a739-5f901445d06b tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:52.065143 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c143a49a-005d-4e24-a739-5f901445d06b tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:52.066265 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c143a49a-005d-4e24-a739-5f901445d06b tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:52.423026 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c143a49a-005d-4e24-a739-5f901445d06b tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:52.437757 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c143a49a-005d-4e24-a739-5f901445d06b tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1310 microversion: 2.1 time: 0.404226 Sep 27 16:38:52.442798 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 141/269] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:52 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1310 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:38:52.562233 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9071ac4e-c2d8-4e53-bf9a-cf90cfa18e79 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:52.562990 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9071ac4e-c2d8-4e53-bf9a-cf90cfa18e79 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:52.573908 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9071ac4e-c2d8-4e53-bf9a-cf90cfa18e79 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:52.575141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9071ac4e-c2d8-4e53-bf9a-cf90cfa18e79 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:52.576390 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9071ac4e-c2d8-4e53-bf9a-cf90cfa18e79 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:52.577828 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9071ac4e-c2d8-4e53-bf9a-cf90cfa18e79 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:52.578965 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9071ac4e-c2d8-4e53-bf9a-cf90cfa18e79 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:52.579594 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9071ac4e-c2d8-4e53-bf9a-cf90cfa18e79 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:52.586933 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-010ce1b1-1116-466d-9c7e-21e7f25d9d5f tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:52.601406 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-010ce1b1-1116-466d-9c7e-21e7f25d9d5f tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 200 len: 1319 microversion: 2.1 time: 0.597819 Sep 27 16:38:52.617997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 129/270] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:52 2022] GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 1319 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:38:52.699805 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-4d5e88e8-d7dc-4eb8-9bd0-1b8a628cd114 req-7ba5b887-a952-4cfe-a8ef-1143454c3831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2bb023b-8f1e-4e58-969b-e6c56395acca", "name": "network-vif-plugged", "status": "completed", "tag": "2cce0dbb-eb5a-403b-b124-6df0f04b0136"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:52.712073 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-4d5e88e8-d7dc-4eb8-9bd0-1b8a628cd114 req-7ba5b887-a952-4cfe-a8ef-1143454c3831 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:52.712586 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-4d5e88e8-d7dc-4eb8-9bd0-1b8a628cd114 req-7ba5b887-a952-4cfe-a8ef-1143454c3831 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:52.713018 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-4d5e88e8-d7dc-4eb8-9bd0-1b8a628cd114 req-7ba5b887-a952-4cfe-a8ef-1143454c3831 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:52.759170 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-4d5e88e8-d7dc-4eb8-9bd0-1b8a628cd114 req-7ba5b887-a952-4cfe-a8ef-1143454c3831 service nova] Creating event network-vif-plugged:2cce0dbb-eb5a-403b-b124-6df0f04b0136 for instance c2bb023b-8f1e-4e58-969b-e6c56395acca on hv-cinder-85506 Sep 27 16:38:52.768491 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-4d5e88e8-d7dc-4eb8-9bd0-1b8a628cd114 req-7ba5b887-a952-4cfe-a8ef-1143454c3831 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087169 Sep 27 16:38:52.772689 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 130/271] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:38:52.787760 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-eaa05815-6e9d-4f40-9b01-8274d17b6a7f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:52.790455 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-eaa05815-6e9d-4f40-9b01-8274d17b6a7f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:52.804805 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eaa05815-6e9d-4f40-9b01-8274d17b6a7f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:52.807624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eaa05815-6e9d-4f40-9b01-8274d17b6a7f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:52.808256 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eaa05815-6e9d-4f40-9b01-8274d17b6a7f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:52.809497 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eaa05815-6e9d-4f40-9b01-8274d17b6a7f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:52.811335 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eaa05815-6e9d-4f40-9b01-8274d17b6a7f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:52.814871 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eaa05815-6e9d-4f40-9b01-8274d17b6a7f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:52.840240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9071ac4e-c2d8-4e53-bf9a-cf90cfa18e79 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:52.857138 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9071ac4e-c2d8-4e53-bf9a-cf90cfa18e79 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:52.860434 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9071ac4e-c2d8-4e53-bf9a-cf90cfa18e79 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:52.866581 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9071ac4e-c2d8-4e53-bf9a-cf90cfa18e79 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1739 microversion: 2.20 time: 0.304347 Sep 27 16:38:52.866581 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 142/272] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:52 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1739 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:38:52.947981 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-eaa05815-6e9d-4f40-9b01-8274d17b6a7f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:52.950845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-61c8de64-be85-4a34-8fa6-4f7b7d0e4bc6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:52.958913 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-61c8de64-be85-4a34-8fa6-4f7b7d0e4bc6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:52.973325 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-eaa05815-6e9d-4f40-9b01-8274d17b6a7f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 200 len: 1272 microversion: 2.1 time: 0.190013 Sep 27 16:38:52.984655 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61c8de64-be85-4a34-8fa6-4f7b7d0e4bc6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:52.984655 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61c8de64-be85-4a34-8fa6-4f7b7d0e4bc6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:52.984655 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61c8de64-be85-4a34-8fa6-4f7b7d0e4bc6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:52.984900 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 131/273] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:52 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 1272 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:52.984976 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61c8de64-be85-4a34-8fa6-4f7b7d0e4bc6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:52.984976 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61c8de64-be85-4a34-8fa6-4f7b7d0e4bc6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:52.984976 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61c8de64-be85-4a34-8fa6-4f7b7d0e4bc6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:53.316156 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-61c8de64-be85-4a34-8fa6-4f7b7d0e4bc6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:53.334155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-61c8de64-be85-4a34-8fa6-4f7b7d0e4bc6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 200 len: 1367 microversion: 2.1 time: 0.389237 Sep 27 16:38:53.334763 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 143/274] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:52 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 1367 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:53.467563 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ab135a52-ca31-452d-b5ff-8bebcc6d92da tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:53.468304 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ab135a52-ca31-452d-b5ff-8bebcc6d92da tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:53.482132 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ab135a52-ca31-452d-b5ff-8bebcc6d92da tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:53.483086 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ab135a52-ca31-452d-b5ff-8bebcc6d92da tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:53.483514 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ab135a52-ca31-452d-b5ff-8bebcc6d92da tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:53.484618 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ab135a52-ca31-452d-b5ff-8bebcc6d92da tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:53.485439 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ab135a52-ca31-452d-b5ff-8bebcc6d92da tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:53.486758 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ab135a52-ca31-452d-b5ff-8bebcc6d92da tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:53.601803 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ab135a52-ca31-452d-b5ff-8bebcc6d92da tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:53.678281 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ab135a52-ca31-452d-b5ff-8bebcc6d92da tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1310 microversion: 2.1 time: 0.148789 Sep 27 16:38:53.678281 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 132/275] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:53 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1310 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:53.679464 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-512e3d6a-217f-4a03-b220-996e661096a7 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:53.679464 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-512e3d6a-217f-4a03-b220-996e661096a7 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:53.679464 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-512e3d6a-217f-4a03-b220-996e661096a7 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:53.679464 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-512e3d6a-217f-4a03-b220-996e661096a7 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:53.680636 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-512e3d6a-217f-4a03-b220-996e661096a7 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:53.680636 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-512e3d6a-217f-4a03-b220-996e661096a7 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:53.680636 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-512e3d6a-217f-4a03-b220-996e661096a7 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:53.680636 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-512e3d6a-217f-4a03-b220-996e661096a7 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:53.799831 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-512e3d6a-217f-4a03-b220-996e661096a7 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:53.817663 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-512e3d6a-217f-4a03-b220-996e661096a7 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 200 len: 1319 microversion: 2.1 time: 0.196010 Sep 27 16:38:53.845954 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 144/276] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:53 2022] GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:53.846629 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f89c18f0-cfdf-4400-b420-4e94a4b12031 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:38:53.849262 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f89c18f0-cfdf-4400-b420-4e94a4b12031 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:53.857033 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f89c18f0-cfdf-4400-b420-4e94a4b12031 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:53.857534 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f89c18f0-cfdf-4400-b420-4e94a4b12031 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:53.858404 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f89c18f0-cfdf-4400-b420-4e94a4b12031 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:53.858671 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f89c18f0-cfdf-4400-b420-4e94a4b12031 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:53.859165 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f89c18f0-cfdf-4400-b420-4e94a4b12031 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:53.862024 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f89c18f0-cfdf-4400-b420-4e94a4b12031 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:53.891762 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-97ac4ac5-0919-47bc-8b1a-70dcb4755dcd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:53.892540 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-97ac4ac5-0919-47bc-8b1a-70dcb4755dcd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:53.906967 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-97ac4ac5-0919-47bc-8b1a-70dcb4755dcd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:53.907755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-97ac4ac5-0919-47bc-8b1a-70dcb4755dcd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:53.908191 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-97ac4ac5-0919-47bc-8b1a-70dcb4755dcd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:53.908901 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-97ac4ac5-0919-47bc-8b1a-70dcb4755dcd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:53.909359 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-97ac4ac5-0919-47bc-8b1a-70dcb4755dcd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:53.910067 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-97ac4ac5-0919-47bc-8b1a-70dcb4755dcd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:53.916507 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-f89c18f0-cfdf-4400-b420-4e94a4b12031 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lazy-loading 'flavor' on Instance uuid 35d1f4b1-f536-4f56-8c18-400be343444b {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:38:54.203662 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-97ac4ac5-0919-47bc-8b1a-70dcb4755dcd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:54.220998 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-97ac4ac5-0919-47bc-8b1a-70dcb4755dcd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:54.233582 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-97ac4ac5-0919-47bc-8b1a-70dcb4755dcd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:54.237053 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-97ac4ac5-0919-47bc-8b1a-70dcb4755dcd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1739 microversion: 2.20 time: 0.349502 Sep 27 16:38:54.238043 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 145/277] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:53 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1739 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:38:54.246523 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f72cfc01-1856-4d21-bbc2-e9a0f2d1a230 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:54.249115 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f72cfc01-1856-4d21-bbc2-e9a0f2d1a230 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:54.267419 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f72cfc01-1856-4d21-bbc2-e9a0f2d1a230 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:54.268965 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f72cfc01-1856-4d21-bbc2-e9a0f2d1a230 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:54.272637 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f72cfc01-1856-4d21-bbc2-e9a0f2d1a230 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:54.274342 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f72cfc01-1856-4d21-bbc2-e9a0f2d1a230 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:54.275436 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f72cfc01-1856-4d21-bbc2-e9a0f2d1a230 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:54.276247 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f72cfc01-1856-4d21-bbc2-e9a0f2d1a230 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:54.325629 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f89c18f0-cfdf-4400-b420-4e94a4b12031 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "POST /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b/action" status: 200 len: 32 microversion: 2.1 time: 0.480795 Sep 27 16:38:54.326823 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 133/278] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Sep 27 16:38:53 2022] POST /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b/action => generated 32 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 27 16:38:54.364136 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bf3a9e9e-283f-49be-8dbe-1125afc4e723 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:54.365973 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bf3a9e9e-283f-49be-8dbe-1125afc4e723 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:54.374366 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf3a9e9e-283f-49be-8dbe-1125afc4e723 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:54.375203 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf3a9e9e-283f-49be-8dbe-1125afc4e723 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:54.376143 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf3a9e9e-283f-49be-8dbe-1125afc4e723 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:54.377205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf3a9e9e-283f-49be-8dbe-1125afc4e723 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:54.377815 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf3a9e9e-283f-49be-8dbe-1125afc4e723 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:54.378438 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bf3a9e9e-283f-49be-8dbe-1125afc4e723 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:54.463719 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f72cfc01-1856-4d21-bbc2-e9a0f2d1a230 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:54.474363 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f72cfc01-1856-4d21-bbc2-e9a0f2d1a230 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 200 len: 1270 microversion: 2.1 time: 0.231901 Sep 27 16:38:54.476825 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 146/279] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:54 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 1270 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:54.506287 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8ed84a13-7d98-4b22-98b8-1f74e299422f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:54.513337 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8ed84a13-7d98-4b22-98b8-1f74e299422f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:54.530466 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ed84a13-7d98-4b22-98b8-1f74e299422f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:54.532222 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ed84a13-7d98-4b22-98b8-1f74e299422f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:54.532667 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ed84a13-7d98-4b22-98b8-1f74e299422f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:54.534539 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ed84a13-7d98-4b22-98b8-1f74e299422f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:54.535285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ed84a13-7d98-4b22-98b8-1f74e299422f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:54.535714 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ed84a13-7d98-4b22-98b8-1f74e299422f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:54.798977 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bf3a9e9e-283f-49be-8dbe-1125afc4e723 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:54.814960 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bf3a9e9e-283f-49be-8dbe-1125afc4e723 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.478589 Sep 27 16:38:54.816581 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 134/280] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:54 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:54.827909 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-57b0366b-7c9f-43f7-af17-0085b41e2d92 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:54.829248 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-57b0366b-7c9f-43f7-af17-0085b41e2d92 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:54.846522 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-57b0366b-7c9f-43f7-af17-0085b41e2d92 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:54.848997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-57b0366b-7c9f-43f7-af17-0085b41e2d92 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:54.852772 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-57b0366b-7c9f-43f7-af17-0085b41e2d92 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:54.858894 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-57b0366b-7c9f-43f7-af17-0085b41e2d92 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:54.859763 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-57b0366b-7c9f-43f7-af17-0085b41e2d92 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:54.860410 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-57b0366b-7c9f-43f7-af17-0085b41e2d92 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:55.014856 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-57b0366b-7c9f-43f7-af17-0085b41e2d92 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:55.029015 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-57b0366b-7c9f-43f7-af17-0085b41e2d92 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1328 microversion: 2.1 time: 0.209571 Sep 27 16:38:55.057136 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 135/281] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:54 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1328 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:55.068457 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-519da689-f36d-4f47-be12-2d96dbf694be tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:55.069363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-519da689-f36d-4f47-be12-2d96dbf694be tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:55.083222 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-519da689-f36d-4f47-be12-2d96dbf694be tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:55.087312 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-519da689-f36d-4f47-be12-2d96dbf694be tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:55.087896 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-519da689-f36d-4f47-be12-2d96dbf694be tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:55.088643 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-519da689-f36d-4f47-be12-2d96dbf694be tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:55.090804 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8ed84a13-7d98-4b22-98b8-1f74e299422f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:55.099428 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-519da689-f36d-4f47-be12-2d96dbf694be tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:55.100719 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-519da689-f36d-4f47-be12-2d96dbf694be tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:55.108711 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8ed84a13-7d98-4b22-98b8-1f74e299422f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 200 len: 1367 microversion: 2.1 time: 0.605985 Sep 27 16:38:55.110060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 147/282] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:54 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 1367 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:55.269479 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f997957d-fcd5-460b-8460-949674208f38 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:55.270267 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f997957d-fcd5-460b-8460-949674208f38 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:55.280281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f997957d-fcd5-460b-8460-949674208f38 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:55.281510 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f997957d-fcd5-460b-8460-949674208f38 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:55.283216 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f997957d-fcd5-460b-8460-949674208f38 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:55.285855 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f997957d-fcd5-460b-8460-949674208f38 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:55.287565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f997957d-fcd5-460b-8460-949674208f38 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:55.289096 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f997957d-fcd5-460b-8460-949674208f38 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:55.296995 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:55.727563 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-519da689-f36d-4f47-be12-2d96dbf694be tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:55.738997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-519da689-f36d-4f47-be12-2d96dbf694be tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 200 len: 1319 microversion: 2.1 time: 0.692877 Sep 27 16:38:55.745541 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 136/283] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:55 2022] GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 1319 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:55.759473 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d17aa701-4c68-4f9f-b7ef-544baee52ba6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:55.767211 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d17aa701-4c68-4f9f-b7ef-544baee52ba6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:55.787616 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d17aa701-4c68-4f9f-b7ef-544baee52ba6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:55.793457 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d17aa701-4c68-4f9f-b7ef-544baee52ba6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:55.795239 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d17aa701-4c68-4f9f-b7ef-544baee52ba6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:55.798468 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d17aa701-4c68-4f9f-b7ef-544baee52ba6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:55.801443 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d17aa701-4c68-4f9f-b7ef-544baee52ba6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:55.803995 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d17aa701-4c68-4f9f-b7ef-544baee52ba6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:55.804372 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f997957d-fcd5-460b-8460-949674208f38 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:55.820990 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f997957d-fcd5-460b-8460-949674208f38 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:55.828267 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f997957d-fcd5-460b-8460-949674208f38 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:55.830431 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f997957d-fcd5-460b-8460-949674208f38 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1739 microversion: 2.20 time: 0.565866 Sep 27 16:38:55.844246 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 148/284] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:55 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1739 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:38:55.861472 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4529aa5d-2b56-4cac-bbb1-d0a48ef284fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:55.864701 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4529aa5d-2b56-4cac-bbb1-d0a48ef284fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:55.873434 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4529aa5d-2b56-4cac-bbb1-d0a48ef284fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:55.874988 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4529aa5d-2b56-4cac-bbb1-d0a48ef284fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:55.875741 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4529aa5d-2b56-4cac-bbb1-d0a48ef284fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:55.876745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4529aa5d-2b56-4cac-bbb1-d0a48ef284fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:55.877448 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4529aa5d-2b56-4cac-bbb1-d0a48ef284fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:55.878559 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4529aa5d-2b56-4cac-bbb1-d0a48ef284fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:56.565400 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4529aa5d-2b56-4cac-bbb1-d0a48ef284fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:56.575269 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d17aa701-4c68-4f9f-b7ef-544baee52ba6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:56.579276 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4529aa5d-2b56-4cac-bbb1-d0a48ef284fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.733254 Sep 27 16:38:56.580945 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 149/285] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:55 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:56.584414 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d17aa701-4c68-4f9f-b7ef-544baee52ba6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 200 len: 1312 microversion: 2.1 time: 0.837578 Sep 27 16:38:56.587313 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 137/286] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:55 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 1312 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:56.592524 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-37fdde83-2aa8-4399-947c-0196cbc55d51 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:56.593156 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-37fdde83-2aa8-4399-947c-0196cbc55d51 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:56.599217 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1b067d4d-ecb3-4d83-b72f-6ae40f883bd0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:56.600113 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1b067d4d-ecb3-4d83-b72f-6ae40f883bd0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:56.613467 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-37fdde83-2aa8-4399-947c-0196cbc55d51 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:56.613564 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b067d4d-ecb3-4d83-b72f-6ae40f883bd0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:56.613658 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-37fdde83-2aa8-4399-947c-0196cbc55d51 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:56.613744 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b067d4d-ecb3-4d83-b72f-6ae40f883bd0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:56.613819 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-37fdde83-2aa8-4399-947c-0196cbc55d51 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:56.613890 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b067d4d-ecb3-4d83-b72f-6ae40f883bd0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:56.613961 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-37fdde83-2aa8-4399-947c-0196cbc55d51 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:56.614032 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b067d4d-ecb3-4d83-b72f-6ae40f883bd0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:56.614111 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-37fdde83-2aa8-4399-947c-0196cbc55d51 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:56.614185 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b067d4d-ecb3-4d83-b72f-6ae40f883bd0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:56.618571 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b067d4d-ecb3-4d83-b72f-6ae40f883bd0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:56.625816 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-37fdde83-2aa8-4399-947c-0196cbc55d51 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:57.194033 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1b067d4d-ecb3-4d83-b72f-6ae40f883bd0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:57.209503 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1b067d4d-ecb3-4d83-b72f-6ae40f883bd0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 200 len: 1557 microversion: 2.1 time: 0.620555 Sep 27 16:38:57.216285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-37fdde83-2aa8-4399-947c-0196cbc55d51 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:57.226587 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 138/287] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:56 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 1557 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:57.236994 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-37fdde83-2aa8-4399-947c-0196cbc55d51 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1358 microversion: 2.1 time: 0.650761 Sep 27 16:38:57.240171 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 150/288] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:56 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1358 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:57.250418 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c0341bad-d8a0-451a-a4f9-9049fd80ee1b tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:57.255235 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c0341bad-d8a0-451a-a4f9-9049fd80ee1b tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:57.271546 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c39f8596-9957-4b99-a4a5-3e9a1c6da803 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:57.273110 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c39f8596-9957-4b99-a4a5-3e9a1c6da803 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:57.279270 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=4 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:57.281641 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c0341bad-d8a0-451a-a4f9-9049fd80ee1b tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:57.287887 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c0341bad-d8a0-451a-a4f9-9049fd80ee1b tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:57.290137 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c0341bad-d8a0-451a-a4f9-9049fd80ee1b tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:57.292056 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c39f8596-9957-4b99-a4a5-3e9a1c6da803 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:57.293720 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c0341bad-d8a0-451a-a4f9-9049fd80ee1b tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:57.296346 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c0341bad-d8a0-451a-a4f9-9049fd80ee1b tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:57.296996 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c0341bad-d8a0-451a-a4f9-9049fd80ee1b tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:57.298037 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c39f8596-9957-4b99-a4a5-3e9a1c6da803 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:57.302685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c39f8596-9957-4b99-a4a5-3e9a1c6da803 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:57.304234 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c39f8596-9957-4b99-a4a5-3e9a1c6da803 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:57.306822 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c39f8596-9957-4b99-a4a5-3e9a1c6da803 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:57.309826 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c39f8596-9957-4b99-a4a5-3e9a1c6da803 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:57.980377 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c0341bad-d8a0-451a-a4f9-9049fd80ee1b tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:57.984346 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c39f8596-9957-4b99-a4a5-3e9a1c6da803 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:57.989098 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c0341bad-d8a0-451a-a4f9-9049fd80ee1b tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 200 len: 1319 microversion: 2.1 time: 0.758649 Sep 27 16:38:57.989676 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 139/289] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:57 2022] GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 1319 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:58.009960 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a0b8eb65-bb76-4b1e-940e-f7e241a17af3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:58.009960 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a0b8eb65-bb76-4b1e-940e-f7e241a17af3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:58.017479 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c39f8596-9957-4b99-a4a5-3e9a1c6da803 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:58.026883 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0b8eb65-bb76-4b1e-940e-f7e241a17af3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:58.028332 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c39f8596-9957-4b99-a4a5-3e9a1c6da803 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:58.030105 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c39f8596-9957-4b99-a4a5-3e9a1c6da803 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1739 microversion: 2.20 time: 0.787796 Sep 27 16:38:58.030836 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0b8eb65-bb76-4b1e-940e-f7e241a17af3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:58.031448 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0b8eb65-bb76-4b1e-940e-f7e241a17af3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:58.036078 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0b8eb65-bb76-4b1e-940e-f7e241a17af3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:58.036849 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 151/290] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:38:57 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1739 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:38:58.038878 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0b8eb65-bb76-4b1e-940e-f7e241a17af3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:58.046645 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0b8eb65-bb76-4b1e-940e-f7e241a17af3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:58.066850 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fd7bda17-54e3-4c26-8076-0b818acb0a2d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:58.068149 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fd7bda17-54e3-4c26-8076-0b818acb0a2d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:58.075944 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:58.089706 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd7bda17-54e3-4c26-8076-0b818acb0a2d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:58.091087 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd7bda17-54e3-4c26-8076-0b818acb0a2d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:58.095428 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd7bda17-54e3-4c26-8076-0b818acb0a2d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:58.096979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd7bda17-54e3-4c26-8076-0b818acb0a2d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:58.098557 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd7bda17-54e3-4c26-8076-0b818acb0a2d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:58.101517 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:58.102281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd7bda17-54e3-4c26-8076-0b818acb0a2d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:58.365645 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a0b8eb65-bb76-4b1e-940e-f7e241a17af3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.374879 Sep 27 16:38:58.367072 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 140/291] 10.222.0.64 () {58 vars in 1275 bytes} [Tue Sep 27 16:38:57 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca/os-interface => generated 285 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:38:58.373012 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-22f91cd6-68d3-4a8d-aee4-d01c5b2b13bf tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:58.373931 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-22f91cd6-68d3-4a8d-aee4-d01c5b2b13bf tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:58.390530 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-22f91cd6-68d3-4a8d-aee4-d01c5b2b13bf tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:58.391624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-22f91cd6-68d3-4a8d-aee4-d01c5b2b13bf tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:58.392231 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-22f91cd6-68d3-4a8d-aee4-d01c5b2b13bf tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:58.393097 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-22f91cd6-68d3-4a8d-aee4-d01c5b2b13bf tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:58.394238 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-22f91cd6-68d3-4a8d-aee4-d01c5b2b13bf tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:58.395391 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-22f91cd6-68d3-4a8d-aee4-d01c5b2b13bf tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:58.795091 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:58.795091 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=24 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:38:59.200916 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fd7bda17-54e3-4c26-8076-0b818acb0a2d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:38:59.221601 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fd7bda17-54e3-4c26-8076-0b818acb0a2d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 1.182814 Sep 27 16:38:59.227378 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 152/292] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:58 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:38:59.240664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-10e036b0-6092-4574-839b-b34b40b7ebe9 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:38:59.245727 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-10e036b0-6092-4574-839b-b34b40b7ebe9 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:38:59.280794 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10e036b0-6092-4574-839b-b34b40b7ebe9 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:59.282013 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10e036b0-6092-4574-839b-b34b40b7ebe9 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:59.282902 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10e036b0-6092-4574-839b-b34b40b7ebe9 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:59.283966 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10e036b0-6092-4574-839b-b34b40b7ebe9 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:38:59.286572 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10e036b0-6092-4574-839b-b34b40b7ebe9 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:38:59.287342 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10e036b0-6092-4574-839b-b34b40b7ebe9 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:38:59.397989 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=16 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:00.015427 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-22f91cd6-68d3-4a8d-aee4-d01c5b2b13bf tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:00.023280 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-22f91cd6-68d3-4a8d-aee4-d01c5b2b13bf tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 200 len: 1312 microversion: 2.1 time: 1.654719 Sep 27 16:39:00.028040 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 141/293] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:58 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 1312 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:00.037591 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-0481abfb-3dbe-4fd6-a60d-200e88cd565a req-8e381e96-da6c-474d-97fc-76e644df105b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab77e6d5-1c27-420a-b7cd-b32c4f418dab", "name": "network-vif-plugged", "status": "completed", "tag": "b076a24a-f4ef-4eb2-b560-505f54ef1e3d"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:00.068937 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0481abfb-3dbe-4fd6-a60d-200e88cd565a req-8e381e96-da6c-474d-97fc-76e644df105b service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:00.069690 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0481abfb-3dbe-4fd6-a60d-200e88cd565a req-8e381e96-da6c-474d-97fc-76e644df105b service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:00.071615 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0481abfb-3dbe-4fd6-a60d-200e88cd565a req-8e381e96-da6c-474d-97fc-76e644df105b service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:00.093378 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-0481abfb-3dbe-4fd6-a60d-200e88cd565a req-8e381e96-da6c-474d-97fc-76e644df105b service nova] Creating event network-vif-plugged:b076a24a-f4ef-4eb2-b560-505f54ef1e3d for instance ab77e6d5-1c27-420a-b7cd-b32c4f418dab on hv-cinder-85506 Sep 27 16:39:00.125712 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-0481abfb-3dbe-4fd6-a60d-200e88cd565a req-8e381e96-da6c-474d-97fc-76e644df105b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095835 Sep 27 16:39:00.131375 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 142/294] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:39:00.141398 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b8d2101d-4f47-4a4f-a0c5-2ced38801f64 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:00.149127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b8d2101d-4f47-4a4f-a0c5-2ced38801f64 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:00.168354 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8d2101d-4f47-4a4f-a0c5-2ced38801f64 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:00.170111 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8d2101d-4f47-4a4f-a0c5-2ced38801f64 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:00.170835 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8d2101d-4f47-4a4f-a0c5-2ced38801f64 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:00.172110 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8d2101d-4f47-4a4f-a0c5-2ced38801f64 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:00.172841 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8d2101d-4f47-4a4f-a0c5-2ced38801f64 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:00.173587 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8d2101d-4f47-4a4f-a0c5-2ced38801f64 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:00.651436 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b8d2101d-4f47-4a4f-a0c5-2ced38801f64 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:00.664404 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b8d2101d-4f47-4a4f-a0c5-2ced38801f64 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 200 len: 1319 microversion: 2.1 time: 0.524245 Sep 27 16:39:00.666285 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 143/295] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:00 2022] GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 1319 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:00.671453 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-81e5a963-dd91-45eb-84e8-90e604182fb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:00.674626 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-81e5a963-dd91-45eb-84e8-90e604182fb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:00.679429 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81e5a963-dd91-45eb-84e8-90e604182fb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:00.680132 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81e5a963-dd91-45eb-84e8-90e604182fb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:00.680712 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81e5a963-dd91-45eb-84e8-90e604182fb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:00.682107 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81e5a963-dd91-45eb-84e8-90e604182fb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:00.682831 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81e5a963-dd91-45eb-84e8-90e604182fb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:00.683462 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81e5a963-dd91-45eb-84e8-90e604182fb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:00.711848 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-10e036b0-6092-4574-839b-b34b40b7ebe9 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:00.741498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-10e036b0-6092-4574-839b-b34b40b7ebe9 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1358 microversion: 2.1 time: 1.512686 Sep 27 16:39:00.780264 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 153/296] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:38:59 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1358 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:00.794429 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-f43ac021-9cf5-4da8-9f58-c3fefa5425d8 req-9f19a11c-84e2-482c-8800-e7c95348b9cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54bed735-4766-4b93-9db9-4c3731eec6c7", "tag": "95614818-7cd1-4590-9696-e7a8c3f6a751"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:00.823916 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-f43ac021-9cf5-4da8-9f58-c3fefa5425d8 req-9f19a11c-84e2-482c-8800-e7c95348b9cc service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:00.826010 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-f43ac021-9cf5-4da8-9f58-c3fefa5425d8 req-9f19a11c-84e2-482c-8800-e7c95348b9cc service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:00.826010 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-f43ac021-9cf5-4da8-9f58-c3fefa5425d8 req-9f19a11c-84e2-482c-8800-e7c95348b9cc service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:00.885660 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-f43ac021-9cf5-4da8-9f58-c3fefa5425d8 req-9f19a11c-84e2-482c-8800-e7c95348b9cc service nova] Creating event network-changed:95614818-7cd1-4590-9696-e7a8c3f6a751 for instance 54bed735-4766-4b93-9db9-4c3731eec6c7 on hv-cinder-85506 Sep 27 16:39:00.895755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-f43ac021-9cf5-4da8-9f58-c3fefa5425d8 req-9f19a11c-84e2-482c-8800-e7c95348b9cc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110549 Sep 27 16:39:00.899273 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 154/297] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:39:00.905834 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-37ff2549-e583-48c4-887b-e75ed72a2142 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:00.906948 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-37ff2549-e583-48c4-887b-e75ed72a2142 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:00.921790 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-37ff2549-e583-48c4-887b-e75ed72a2142 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:00.923569 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-37ff2549-e583-48c4-887b-e75ed72a2142 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:00.924678 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-37ff2549-e583-48c4-887b-e75ed72a2142 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:00.936598 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-37ff2549-e583-48c4-887b-e75ed72a2142 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:00.937728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-37ff2549-e583-48c4-887b-e75ed72a2142 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:00.939455 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-37ff2549-e583-48c4-887b-e75ed72a2142 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:01.130871 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-81e5a963-dd91-45eb-84e8-90e604182fb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:01.142661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-81e5a963-dd91-45eb-84e8-90e604182fb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:01.144516 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-81e5a963-dd91-45eb-84e8-90e604182fb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:01.151293 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-81e5a963-dd91-45eb-84e8-90e604182fb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1739 microversion: 2.20 time: 0.481054 Sep 27 16:39:01.152212 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 144/298] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:00 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1739 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:01.163953 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-a2c7226f-d848-4295-a735-57f88656b64e req-d017ad4b-a17e-4286-bbb5-504690f32647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b13caeb-5d84-44a8-bfaa-fb75150bec2f", "tag": "f7d376fe-e5b1-4dc1-9503-bd20dcb08471"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:01.188217 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a2c7226f-d848-4295-a735-57f88656b64e req-d017ad4b-a17e-4286-bbb5-504690f32647 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:01.189454 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a2c7226f-d848-4295-a735-57f88656b64e req-d017ad4b-a17e-4286-bbb5-504690f32647 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:01.191545 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a2c7226f-d848-4295-a735-57f88656b64e req-d017ad4b-a17e-4286-bbb5-504690f32647 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:01.221463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-a2c7226f-d848-4295-a735-57f88656b64e req-d017ad4b-a17e-4286-bbb5-504690f32647 service nova] Creating event network-changed:f7d376fe-e5b1-4dc1-9503-bd20dcb08471 for instance 2b13caeb-5d84-44a8-bfaa-fb75150bec2f on hv-cinder-85506 Sep 27 16:39:01.237361 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-a2c7226f-d848-4295-a735-57f88656b64e req-d017ad4b-a17e-4286-bbb5-504690f32647 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082194 Sep 27 16:39:01.238140 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 145/299] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:39:01.251441 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d2678f79-65d5-4be2-9463-9cf5c817a07a tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:01.255103 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d2678f79-65d5-4be2-9463-9cf5c817a07a tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:01.266694 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2678f79-65d5-4be2-9463-9cf5c817a07a tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:01.267574 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2678f79-65d5-4be2-9463-9cf5c817a07a tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:01.267704 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2678f79-65d5-4be2-9463-9cf5c817a07a tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:01.271579 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2678f79-65d5-4be2-9463-9cf5c817a07a tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:01.276148 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2678f79-65d5-4be2-9463-9cf5c817a07a tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:01.276864 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2678f79-65d5-4be2-9463-9cf5c817a07a tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:01.363458 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-37ff2549-e583-48c4-887b-e75ed72a2142 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:01.376979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-37ff2549-e583-48c4-887b-e75ed72a2142 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.475951 Sep 27 16:39:01.377951 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 155/300] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:00 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:01.601946 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d2678f79-65d5-4be2-9463-9cf5c817a07a tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:01.611626 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d2678f79-65d5-4be2-9463-9cf5c817a07a tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 200 len: 1312 microversion: 2.1 time: 0.370683 Sep 27 16:39:01.614854 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 146/301] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:01 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 1312 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:01.688435 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1b94c403-ace0-4acb-9ad5-4ec86753e065 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:01.689464 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1b94c403-ace0-4acb-9ad5-4ec86753e065 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:01.712736 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b94c403-ace0-4acb-9ad5-4ec86753e065 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:01.713431 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b94c403-ace0-4acb-9ad5-4ec86753e065 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:01.713906 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b94c403-ace0-4acb-9ad5-4ec86753e065 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:01.714745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b94c403-ace0-4acb-9ad5-4ec86753e065 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:01.715408 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b94c403-ace0-4acb-9ad5-4ec86753e065 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:01.716041 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b94c403-ace0-4acb-9ad5-4ec86753e065 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:01.782367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-44c0c8de-0ef0-4cc8-aa0b-396defd0e2bc tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:01.783590 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-44c0c8de-0ef0-4cc8-aa0b-396defd0e2bc tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:01.793797 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-44c0c8de-0ef0-4cc8-aa0b-396defd0e2bc tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:01.803276 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-44c0c8de-0ef0-4cc8-aa0b-396defd0e2bc tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:01.803979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-44c0c8de-0ef0-4cc8-aa0b-396defd0e2bc tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:01.805091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-44c0c8de-0ef0-4cc8-aa0b-396defd0e2bc tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:01.811222 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-44c0c8de-0ef0-4cc8-aa0b-396defd0e2bc tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:01.811901 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-44c0c8de-0ef0-4cc8-aa0b-396defd0e2bc tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:02.074946 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1b94c403-ace0-4acb-9ad5-4ec86753e065 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:02.085872 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1b94c403-ace0-4acb-9ad5-4ec86753e065 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 200 len: 1319 microversion: 2.1 time: 0.399354 Sep 27 16:39:02.090982 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 156/302] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:01 2022] GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 1319 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:02.183279 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7b3f8050-4fd7-43af-9533-5941fca11c34 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:02.184175 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7b3f8050-4fd7-43af-9533-5941fca11c34 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:02.201140 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b3f8050-4fd7-43af-9533-5941fca11c34 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:02.201922 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b3f8050-4fd7-43af-9533-5941fca11c34 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:02.202547 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b3f8050-4fd7-43af-9533-5941fca11c34 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:02.203457 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b3f8050-4fd7-43af-9533-5941fca11c34 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:02.204084 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b3f8050-4fd7-43af-9533-5941fca11c34 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:02.204670 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b3f8050-4fd7-43af-9533-5941fca11c34 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:02.830622 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-44c0c8de-0ef0-4cc8-aa0b-396defd0e2bc tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:02.853331 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-44c0c8de-0ef0-4cc8-aa0b-396defd0e2bc tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1358 microversion: 2.1 time: 1.074737 Sep 27 16:39:02.854767 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 147/303] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:01 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1358 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:02.860574 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-21b53b80-f7a3-4753-98db-1af4e47347f1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:02.861412 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-21b53b80-f7a3-4753-98db-1af4e47347f1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:02.871636 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-21b53b80-f7a3-4753-98db-1af4e47347f1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:02.872491 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-21b53b80-f7a3-4753-98db-1af4e47347f1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:02.873180 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-21b53b80-f7a3-4753-98db-1af4e47347f1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:02.874693 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-21b53b80-f7a3-4753-98db-1af4e47347f1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:02.875457 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-21b53b80-f7a3-4753-98db-1af4e47347f1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:02.876144 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-21b53b80-f7a3-4753-98db-1af4e47347f1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:02.978480 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7b3f8050-4fd7-43af-9533-5941fca11c34 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:02.987494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7b3f8050-4fd7-43af-9533-5941fca11c34 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:02.992460 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7b3f8050-4fd7-43af-9533-5941fca11c34 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:03.000159 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7b3f8050-4fd7-43af-9533-5941fca11c34 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1739 microversion: 2.20 time: 0.822505 Sep 27 16:39:03.001101 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 157/304] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:02 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1739 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:03.009957 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cd0958d3-5a20-4840-a1dc-ebbdff902045 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:03.011074 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cd0958d3-5a20-4840-a1dc-ebbdff902045 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:03.028679 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd0958d3-5a20-4840-a1dc-ebbdff902045 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:03.029183 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd0958d3-5a20-4840-a1dc-ebbdff902045 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:03.029629 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd0958d3-5a20-4840-a1dc-ebbdff902045 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:03.030887 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd0958d3-5a20-4840-a1dc-ebbdff902045 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:03.030887 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd0958d3-5a20-4840-a1dc-ebbdff902045 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:03.031242 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd0958d3-5a20-4840-a1dc-ebbdff902045 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:03.133370 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-21b53b80-f7a3-4753-98db-1af4e47347f1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:03.149648 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-21b53b80-f7a3-4753-98db-1af4e47347f1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.292649 Sep 27 16:39:03.150684 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 148/305] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:02 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:03.165856 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d8262eaa-c312-481e-8ad6-dbd1cc88e175 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:03.167236 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d8262eaa-c312-481e-8ad6-dbd1cc88e175 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:03.177283 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8262eaa-c312-481e-8ad6-dbd1cc88e175 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:03.178533 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8262eaa-c312-481e-8ad6-dbd1cc88e175 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:03.179543 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8262eaa-c312-481e-8ad6-dbd1cc88e175 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:03.180667 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8262eaa-c312-481e-8ad6-dbd1cc88e175 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:03.182030 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8262eaa-c312-481e-8ad6-dbd1cc88e175 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:03.184410 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8262eaa-c312-481e-8ad6-dbd1cc88e175 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:03.508797 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cd0958d3-5a20-4840-a1dc-ebbdff902045 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:03.518997 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cd0958d3-5a20-4840-a1dc-ebbdff902045 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 200 len: 1312 microversion: 2.1 time: 0.516495 Sep 27 16:39:03.523795 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 158/306] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:03 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 1312 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:03.532158 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d8262eaa-c312-481e-8ad6-dbd1cc88e175 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:03.541247 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-9bbd4e83-12b6-4da7-8211-424d2778e447 req-d8a4a102-2f44-4724-bfad-c5ec2781223c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2bb023b-8f1e-4e58-969b-e6c56395acca", "tag": "2cce0dbb-eb5a-403b-b124-6df0f04b0136"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:03.541538 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d8262eaa-c312-481e-8ad6-dbd1cc88e175 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 200 len: 1319 microversion: 2.1 time: 0.389441 Sep 27 16:39:03.542622 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 149/307] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:03 2022] GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:03.561819 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-9bbd4e83-12b6-4da7-8211-424d2778e447 req-d8a4a102-2f44-4724-bfad-c5ec2781223c service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:03.570903 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-9bbd4e83-12b6-4da7-8211-424d2778e447 req-d8a4a102-2f44-4724-bfad-c5ec2781223c service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:03.574509 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-9bbd4e83-12b6-4da7-8211-424d2778e447 req-d8a4a102-2f44-4724-bfad-c5ec2781223c service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:03.592149 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-9bbd4e83-12b6-4da7-8211-424d2778e447 req-d8a4a102-2f44-4724-bfad-c5ec2781223c service nova] Creating event network-changed:2cce0dbb-eb5a-403b-b124-6df0f04b0136 for instance c2bb023b-8f1e-4e58-969b-e6c56395acca on hv-cinder-85506 Sep 27 16:39:03.599469 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-9bbd4e83-12b6-4da7-8211-424d2778e447 req-d8a4a102-2f44-4724-bfad-c5ec2781223c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073980 Sep 27 16:39:03.603484 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 159/308] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:39:03.885152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-744b1f86-dc8f-44ad-9387-50ef4e5c6e87 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:03.886214 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-744b1f86-dc8f-44ad-9387-50ef4e5c6e87 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:03.906653 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-744b1f86-dc8f-44ad-9387-50ef4e5c6e87 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:03.908713 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-744b1f86-dc8f-44ad-9387-50ef4e5c6e87 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:03.908713 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-744b1f86-dc8f-44ad-9387-50ef4e5c6e87 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:03.914658 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-744b1f86-dc8f-44ad-9387-50ef4e5c6e87 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:03.915366 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-744b1f86-dc8f-44ad-9387-50ef4e5c6e87 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:03.916120 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-744b1f86-dc8f-44ad-9387-50ef4e5c6e87 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:04.033126 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-814bbb89-b2f1-4b58-b22f-16b9fc6083a8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:04.034519 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-814bbb89-b2f1-4b58-b22f-16b9fc6083a8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:04.050230 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-814bbb89-b2f1-4b58-b22f-16b9fc6083a8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:04.053081 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-814bbb89-b2f1-4b58-b22f-16b9fc6083a8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:04.062295 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-814bbb89-b2f1-4b58-b22f-16b9fc6083a8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:04.063244 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-814bbb89-b2f1-4b58-b22f-16b9fc6083a8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:04.063947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-814bbb89-b2f1-4b58-b22f-16b9fc6083a8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:04.064621 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-814bbb89-b2f1-4b58-b22f-16b9fc6083a8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:04.247126 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-744b1f86-dc8f-44ad-9387-50ef4e5c6e87 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:04.261853 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-744b1f86-dc8f-44ad-9387-50ef4e5c6e87 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1358 microversion: 2.1 time: 0.381458 Sep 27 16:39:04.263111 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 150/309] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:03 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1358 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:04.268291 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d88eacb8-8042-47ee-a472-1995945742e0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:04.271512 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d88eacb8-8042-47ee-a472-1995945742e0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:04.289056 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d88eacb8-8042-47ee-a472-1995945742e0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:04.291240 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d88eacb8-8042-47ee-a472-1995945742e0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:04.294868 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d88eacb8-8042-47ee-a472-1995945742e0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:04.295823 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d88eacb8-8042-47ee-a472-1995945742e0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:04.296454 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d88eacb8-8042-47ee-a472-1995945742e0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:04.301361 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d88eacb8-8042-47ee-a472-1995945742e0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:04.310662 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-814bbb89-b2f1-4b58-b22f-16b9fc6083a8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:04.324233 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-814bbb89-b2f1-4b58-b22f-16b9fc6083a8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:04.326453 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-814bbb89-b2f1-4b58-b22f-16b9fc6083a8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:04.327870 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-814bbb89-b2f1-4b58-b22f-16b9fc6083a8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1739 microversion: 2.20 time: 0.299548 Sep 27 16:39:04.333783 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 160/310] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:04 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1739 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:39:04.549095 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-039e31a4-fcfe-42bb-8420-3a11e5a3881b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:04.549709 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-039e31a4-fcfe-42bb-8420-3a11e5a3881b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:04.561491 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d88eacb8-8042-47ee-a472-1995945742e0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:04.562581 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-039e31a4-fcfe-42bb-8420-3a11e5a3881b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:04.563121 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-039e31a4-fcfe-42bb-8420-3a11e5a3881b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:04.563572 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-039e31a4-fcfe-42bb-8420-3a11e5a3881b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:04.564300 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-039e31a4-fcfe-42bb-8420-3a11e5a3881b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:04.564775 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-039e31a4-fcfe-42bb-8420-3a11e5a3881b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:04.565206 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-039e31a4-fcfe-42bb-8420-3a11e5a3881b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:04.570762 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d88eacb8-8042-47ee-a472-1995945742e0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.305953 Sep 27 16:39:04.590996 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 151/311] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:04 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:04.596400 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fd374ef2-3e1e-41a2-81bd-08e4329bb4e1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:04.602011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fd374ef2-3e1e-41a2-81bd-08e4329bb4e1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:04.620840 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fd374ef2-3e1e-41a2-81bd-08e4329bb4e1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:04.621353 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fd374ef2-3e1e-41a2-81bd-08e4329bb4e1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:04.621795 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fd374ef2-3e1e-41a2-81bd-08e4329bb4e1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:04.622580 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fd374ef2-3e1e-41a2-81bd-08e4329bb4e1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:04.624147 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fd374ef2-3e1e-41a2-81bd-08e4329bb4e1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:04.625135 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fd374ef2-3e1e-41a2-81bd-08e4329bb4e1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:04.993182 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-039e31a4-fcfe-42bb-8420-3a11e5a3881b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:05.005094 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-039e31a4-fcfe-42bb-8420-3a11e5a3881b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 200 len: 1312 microversion: 2.1 time: 0.459833 Sep 27 16:39:05.020654 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 161/312] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:04 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 1312 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:39:05.079057 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fd374ef2-3e1e-41a2-81bd-08e4329bb4e1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:05.091487 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fd374ef2-3e1e-41a2-81bd-08e4329bb4e1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 200 len: 1508 microversion: 2.1 time: 0.497330 Sep 27 16:39:05.108498 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 152/313] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:04 2022] GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 1508 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:05.295505 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ee00f641-5c6e-4010-b0e5-5bc0602d711e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:05.296126 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ee00f641-5c6e-4010-b0e5-5bc0602d711e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:05.307226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee00f641-5c6e-4010-b0e5-5bc0602d711e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:05.307726 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee00f641-5c6e-4010-b0e5-5bc0602d711e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:05.309563 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee00f641-5c6e-4010-b0e5-5bc0602d711e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:05.310316 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee00f641-5c6e-4010-b0e5-5bc0602d711e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:05.310879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee00f641-5c6e-4010-b0e5-5bc0602d711e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:05.315452 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee00f641-5c6e-4010-b0e5-5bc0602d711e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:05.358054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2f75992e-e41f-49fc-a962-959dc7de5d3a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:05.358966 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2f75992e-e41f-49fc-a962-959dc7de5d3a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:05.362291 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:05.367694 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f75992e-e41f-49fc-a962-959dc7de5d3a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:05.371083 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f75992e-e41f-49fc-a962-959dc7de5d3a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:05.371688 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f75992e-e41f-49fc-a962-959dc7de5d3a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:05.382278 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f75992e-e41f-49fc-a962-959dc7de5d3a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:05.383106 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f75992e-e41f-49fc-a962-959dc7de5d3a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:05.383735 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f75992e-e41f-49fc-a962-959dc7de5d3a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:06.001236 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2f75992e-e41f-49fc-a962-959dc7de5d3a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:06.018479 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2f75992e-e41f-49fc-a962-959dc7de5d3a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:06.024900 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2f75992e-e41f-49fc-a962-959dc7de5d3a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:06.024900 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2f75992e-e41f-49fc-a962-959dc7de5d3a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1721 microversion: 2.20 time: 0.670543 Sep 27 16:39:06.056938 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ee00f641-5c6e-4010-b0e5-5bc0602d711e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:06.066862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 153/314] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:05 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1721 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:06.077162 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ee00f641-5c6e-4010-b0e5-5bc0602d711e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1358 microversion: 2.1 time: 0.786837 Sep 27 16:39:06.085462 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 162/315] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:05 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1358 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:06.086397 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-87bd5b17-afc5-4d06-8f5c-33db057d9df2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:06.087796 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-87bd5b17-afc5-4d06-8f5c-33db057d9df2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:06.100937 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0c390f61-78c0-488c-8eba-41de6d078620 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:06.105773 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0c390f61-78c0-488c-8eba-41de6d078620 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:06.128212 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87bd5b17-afc5-4d06-8f5c-33db057d9df2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:06.130555 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87bd5b17-afc5-4d06-8f5c-33db057d9df2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:06.131674 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87bd5b17-afc5-4d06-8f5c-33db057d9df2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:06.133890 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c390f61-78c0-488c-8eba-41de6d078620 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:06.135284 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c390f61-78c0-488c-8eba-41de6d078620 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:06.135415 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87bd5b17-afc5-4d06-8f5c-33db057d9df2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:06.138473 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c390f61-78c0-488c-8eba-41de6d078620 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:06.139450 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c390f61-78c0-488c-8eba-41de6d078620 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:06.140194 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87bd5b17-afc5-4d06-8f5c-33db057d9df2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:06.140708 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c390f61-78c0-488c-8eba-41de6d078620 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:06.141920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c390f61-78c0-488c-8eba-41de6d078620 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:06.142402 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87bd5b17-afc5-4d06-8f5c-33db057d9df2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:06.445464 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-87bd5b17-afc5-4d06-8f5c-33db057d9df2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:06.453622 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0c390f61-78c0-488c-8eba-41de6d078620 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:06.455857 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-87bd5b17-afc5-4d06-8f5c-33db057d9df2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.387454 Sep 27 16:39:06.456596 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 154/316] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:06 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:06.461605 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0c390f61-78c0-488c-8eba-41de6d078620 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 200 len: 1312 microversion: 2.1 time: 0.381615 Sep 27 16:39:06.469100 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 163/317] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:06 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 1312 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:07.053627 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-518afdee-2847-44f2-a7d3-bae1a818419f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:07.054272 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-518afdee-2847-44f2-a7d3-bae1a818419f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:07.061819 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-518afdee-2847-44f2-a7d3-bae1a818419f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:07.062306 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-518afdee-2847-44f2-a7d3-bae1a818419f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:07.062734 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-518afdee-2847-44f2-a7d3-bae1a818419f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:07.063457 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-518afdee-2847-44f2-a7d3-bae1a818419f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:07.064127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-518afdee-2847-44f2-a7d3-bae1a818419f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:07.064322 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-518afdee-2847-44f2-a7d3-bae1a818419f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:07.102546 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8027d49b-40a8-4bde-9b54-0b247c7a33d0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:07.103861 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8027d49b-40a8-4bde-9b54-0b247c7a33d0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:07.110562 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8027d49b-40a8-4bde-9b54-0b247c7a33d0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:07.111084 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8027d49b-40a8-4bde-9b54-0b247c7a33d0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:07.111525 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8027d49b-40a8-4bde-9b54-0b247c7a33d0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:07.112238 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8027d49b-40a8-4bde-9b54-0b247c7a33d0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:07.112739 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8027d49b-40a8-4bde-9b54-0b247c7a33d0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:07.113227 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8027d49b-40a8-4bde-9b54-0b247c7a33d0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:07.444721 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-518afdee-2847-44f2-a7d3-bae1a818419f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:07.464822 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-518afdee-2847-44f2-a7d3-bae1a818419f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:07.470624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-518afdee-2847-44f2-a7d3-bae1a818419f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:07.473508 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-518afdee-2847-44f2-a7d3-bae1a818419f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1721 microversion: 2.20 time: 0.423588 Sep 27 16:39:07.487506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 155/318] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:07 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1721 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:07.512101 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c6632e0f-5864-4a3b-a705-386a867d159f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:07.512706 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c6632e0f-5864-4a3b-a705-386a867d159f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:07.529629 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8027d49b-40a8-4bde-9b54-0b247c7a33d0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:07.538291 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c6632e0f-5864-4a3b-a705-386a867d159f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:07.538291 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c6632e0f-5864-4a3b-a705-386a867d159f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:07.538291 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c6632e0f-5864-4a3b-a705-386a867d159f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:07.538291 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c6632e0f-5864-4a3b-a705-386a867d159f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:07.538597 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c6632e0f-5864-4a3b-a705-386a867d159f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:07.538597 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c6632e0f-5864-4a3b-a705-386a867d159f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:07.539949 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8027d49b-40a8-4bde-9b54-0b247c7a33d0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1358 microversion: 2.1 time: 0.441039 Sep 27 16:39:07.541126 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 164/319] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:07 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1358 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:39:07.568233 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-98897754-f129-49b3-b7e7-a68d6728dc63 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:07.571763 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-98897754-f129-49b3-b7e7-a68d6728dc63 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:07.587746 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-98897754-f129-49b3-b7e7-a68d6728dc63 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:07.588635 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-98897754-f129-49b3-b7e7-a68d6728dc63 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:07.591583 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-98897754-f129-49b3-b7e7-a68d6728dc63 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:07.599409 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-98897754-f129-49b3-b7e7-a68d6728dc63 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:07.599927 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-98897754-f129-49b3-b7e7-a68d6728dc63 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:07.602166 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-98897754-f129-49b3-b7e7-a68d6728dc63 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:07.911448 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-98897754-f129-49b3-b7e7-a68d6728dc63 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:07.925216 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-98897754-f129-49b3-b7e7-a68d6728dc63 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 200 len: 1312 microversion: 2.1 time: 0.382798 Sep 27 16:39:07.930077 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 165/320] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:07 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 1312 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:07.931649 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c6632e0f-5864-4a3b-a705-386a867d159f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:07.946126 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c6632e0f-5864-4a3b-a705-386a867d159f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.437808 Sep 27 16:39:07.950878 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 156/321] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:07 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:08.505714 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a7bc5476-bace-427e-9538-c8ae20d55f13 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:08.506438 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a7bc5476-bace-427e-9538-c8ae20d55f13 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:08.521379 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a7bc5476-bace-427e-9538-c8ae20d55f13 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:08.522282 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a7bc5476-bace-427e-9538-c8ae20d55f13 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:08.523071 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a7bc5476-bace-427e-9538-c8ae20d55f13 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:08.524086 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a7bc5476-bace-427e-9538-c8ae20d55f13 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:08.527439 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a7bc5476-bace-427e-9538-c8ae20d55f13 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:08.528244 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a7bc5476-bace-427e-9538-c8ae20d55f13 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:08.534532 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:08.564162 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ee07a65c-d37c-46b0-8a99-f4109c4ec916 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:08.565423 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ee07a65c-d37c-46b0-8a99-f4109c4ec916 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:08.577640 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee07a65c-d37c-46b0-8a99-f4109c4ec916 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:08.579922 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee07a65c-d37c-46b0-8a99-f4109c4ec916 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:08.588574 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee07a65c-d37c-46b0-8a99-f4109c4ec916 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:08.588574 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee07a65c-d37c-46b0-8a99-f4109c4ec916 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:08.588574 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee07a65c-d37c-46b0-8a99-f4109c4ec916 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:08.588574 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee07a65c-d37c-46b0-8a99-f4109c4ec916 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:09.120569 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a7bc5476-bace-427e-9538-c8ae20d55f13 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:09.151444 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a7bc5476-bace-427e-9538-c8ae20d55f13 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:09.170979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a7bc5476-bace-427e-9538-c8ae20d55f13 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:09.170979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a7bc5476-bace-427e-9538-c8ae20d55f13 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1721 microversion: 2.20 time: 0.657211 Sep 27 16:39:09.170979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 166/322] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:08 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1721 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:09.171480 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-fb3f6ae7-05ba-4bad-88f8-1e6fefeabae4 req-9a4bb30e-b46f-4eee-a663-43a2df0f67fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84acf37-9445-48cd-a921-12a7a3c301d9", "name": "network-vif-unplugged", "status": "completed", "tag": "184e6faa-be62-4210-acc1-64aceea7f1f0"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:09.200303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-fb3f6ae7-05ba-4bad-88f8-1e6fefeabae4 req-9a4bb30e-b46f-4eee-a663-43a2df0f67fa service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:09.200789 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-fb3f6ae7-05ba-4bad-88f8-1e6fefeabae4 req-9a4bb30e-b46f-4eee-a663-43a2df0f67fa service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:09.204332 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-fb3f6ae7-05ba-4bad-88f8-1e6fefeabae4 req-9a4bb30e-b46f-4eee-a663-43a2df0f67fa service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:09.233493 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-fb3f6ae7-05ba-4bad-88f8-1e6fefeabae4 req-9a4bb30e-b46f-4eee-a663-43a2df0f67fa service nova] Creating event network-vif-unplugged:184e6faa-be62-4210-acc1-64aceea7f1f0 for instance f84acf37-9445-48cd-a921-12a7a3c301d9 on hv-cinder-85506 Sep 27 16:39:09.240743 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-fb3f6ae7-05ba-4bad-88f8-1e6fefeabae4 req-9a4bb30e-b46f-4eee-a663-43a2df0f67fa service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073518 Sep 27 16:39:09.241618 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 167/323] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:39:09.252681 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-61973cc1-8860-4ba4-bab5-449a7112112a tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:09.262209 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-61973cc1-8860-4ba4-bab5-449a7112112a tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:09.279486 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61973cc1-8860-4ba4-bab5-449a7112112a tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:09.286050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61973cc1-8860-4ba4-bab5-449a7112112a tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:09.286050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61973cc1-8860-4ba4-bab5-449a7112112a tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:09.286050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61973cc1-8860-4ba4-bab5-449a7112112a tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:09.286050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61973cc1-8860-4ba4-bab5-449a7112112a tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:09.286405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61973cc1-8860-4ba4-bab5-449a7112112a tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:09.357662 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ee07a65c-d37c-46b0-8a99-f4109c4ec916 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:09.377273 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ee07a65c-d37c-46b0-8a99-f4109c4ec916 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1358 microversion: 2.1 time: 0.817587 Sep 27 16:39:09.378533 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 157/324] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:08 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1358 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:09.383488 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-91447e4d-3e00-49fc-9e7c-e98391a1203f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:09.396608 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-91447e4d-3e00-49fc-9e7c-e98391a1203f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:09.413572 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-91447e4d-3e00-49fc-9e7c-e98391a1203f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:09.423588 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-91447e4d-3e00-49fc-9e7c-e98391a1203f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:09.425817 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-91447e4d-3e00-49fc-9e7c-e98391a1203f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:09.425817 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-91447e4d-3e00-49fc-9e7c-e98391a1203f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:09.425817 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-91447e4d-3e00-49fc-9e7c-e98391a1203f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:09.426396 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-91447e4d-3e00-49fc-9e7c-e98391a1203f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:09.817090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-61973cc1-8860-4ba4-bab5-449a7112112a tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:09.828501 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-91447e4d-3e00-49fc-9e7c-e98391a1203f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:09.833252 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:09.838924 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-91447e4d-3e00-49fc-9e7c-e98391a1203f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.459019 Sep 27 16:39:09.842194 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-61973cc1-8860-4ba4-bab5-449a7112112a tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 200 len: 1312 microversion: 2.1 time: 0.593874 Sep 27 16:39:09.848981 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 168/325] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:09 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 1312 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:09.871653 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 158/326] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:09 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:10.188696 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a2982b09-5805-43b2-86eb-0c269fd87a73 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:10.189453 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a2982b09-5805-43b2-86eb-0c269fd87a73 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:10.201081 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2982b09-5805-43b2-86eb-0c269fd87a73 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:10.204181 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2982b09-5805-43b2-86eb-0c269fd87a73 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:10.206197 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2982b09-5805-43b2-86eb-0c269fd87a73 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:10.207218 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2982b09-5805-43b2-86eb-0c269fd87a73 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:10.208853 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2982b09-5805-43b2-86eb-0c269fd87a73 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:10.209591 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2982b09-5805-43b2-86eb-0c269fd87a73 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:10.421307 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bfa5fa92-c3a7-4eaf-8429-af62939deff0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:10.426579 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bfa5fa92-c3a7-4eaf-8429-af62939deff0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:10.439104 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfa5fa92-c3a7-4eaf-8429-af62939deff0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:10.439983 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfa5fa92-c3a7-4eaf-8429-af62939deff0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:10.440679 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfa5fa92-c3a7-4eaf-8429-af62939deff0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:10.441626 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfa5fa92-c3a7-4eaf-8429-af62939deff0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:10.442299 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfa5fa92-c3a7-4eaf-8429-af62939deff0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:10.443059 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfa5fa92-c3a7-4eaf-8429-af62939deff0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:10.450478 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a2982b09-5805-43b2-86eb-0c269fd87a73 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:10.470506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a2982b09-5805-43b2-86eb-0c269fd87a73 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:10.476122 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a2982b09-5805-43b2-86eb-0c269fd87a73 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:10.477551 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a2982b09-5805-43b2-86eb-0c269fd87a73 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1721 microversion: 2.20 time: 0.293964 Sep 27 16:39:10.480257 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 169/327] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:10 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1721 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:10.769835 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bfa5fa92-c3a7-4eaf-8429-af62939deff0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:10.777398 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bfa5fa92-c3a7-4eaf-8429-af62939deff0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1358 microversion: 2.1 time: 0.372237 Sep 27 16:39:10.794819 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 159/328] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:10 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1358 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:10.879216 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-267634a1-867b-425f-a28a-ada4659688ad tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:10.879886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b768b57f-f84b-46f1-9bb8-d9fb8ba4a054 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:10.880733 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b768b57f-f84b-46f1-9bb8-d9fb8ba4a054 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:10.881417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-267634a1-867b-425f-a28a-ada4659688ad tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:10.902610 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-267634a1-867b-425f-a28a-ada4659688ad tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:10.903641 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-267634a1-867b-425f-a28a-ada4659688ad tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:10.904381 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-267634a1-867b-425f-a28a-ada4659688ad tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:10.905504 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-267634a1-867b-425f-a28a-ada4659688ad tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:10.906448 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b768b57f-f84b-46f1-9bb8-d9fb8ba4a054 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:10.906685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-267634a1-867b-425f-a28a-ada4659688ad tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:10.907018 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b768b57f-f84b-46f1-9bb8-d9fb8ba4a054 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:10.908889 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-267634a1-867b-425f-a28a-ada4659688ad tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:10.910088 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b768b57f-f84b-46f1-9bb8-d9fb8ba4a054 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:10.911026 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b768b57f-f84b-46f1-9bb8-d9fb8ba4a054 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:10.920638 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b768b57f-f84b-46f1-9bb8-d9fb8ba4a054 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:10.921196 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b768b57f-f84b-46f1-9bb8-d9fb8ba4a054 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:11.287098 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-267634a1-867b-425f-a28a-ada4659688ad tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:11.305347 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-267634a1-867b-425f-a28a-ada4659688ad tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.428728 Sep 27 16:39:11.312693 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b768b57f-f84b-46f1-9bb8-d9fb8ba4a054 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:11.324755 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 160/329] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:10 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:11.326499 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b768b57f-f84b-46f1-9bb8-d9fb8ba4a054 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 200 len: 1312 microversion: 2.1 time: 0.452585 Sep 27 16:39:11.339753 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 170/330] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:10 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 1312 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:11.373366 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-141ec220-466f-4506-955b-fa1b1bbf5348 req-a0ead4e7-2ec1-4c63-b80a-d4eb19d94852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b13caeb-5d84-44a8-bfaa-fb75150bec2f", "name": "network-vif-plugged", "status": "completed", "tag": "f7d376fe-e5b1-4dc1-9503-bd20dcb08471"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:11.394059 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-141ec220-466f-4506-955b-fa1b1bbf5348 req-a0ead4e7-2ec1-4c63-b80a-d4eb19d94852 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:11.404602 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-141ec220-466f-4506-955b-fa1b1bbf5348 req-a0ead4e7-2ec1-4c63-b80a-d4eb19d94852 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:11.406021 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-141ec220-466f-4506-955b-fa1b1bbf5348 req-a0ead4e7-2ec1-4c63-b80a-d4eb19d94852 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:11.438393 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-141ec220-466f-4506-955b-fa1b1bbf5348 req-a0ead4e7-2ec1-4c63-b80a-d4eb19d94852 service nova] Creating event network-vif-plugged:f7d376fe-e5b1-4dc1-9503-bd20dcb08471 for instance 2b13caeb-5d84-44a8-bfaa-fb75150bec2f on hv-cinder-85506 Sep 27 16:39:11.445464 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-141ec220-466f-4506-955b-fa1b1bbf5348 req-a0ead4e7-2ec1-4c63-b80a-d4eb19d94852 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075499 Sep 27 16:39:11.448752 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 161/331] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:39:11.508756 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ecb562ae-9361-43be-b9e3-b55cc765278f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:11.510012 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ecb562ae-9361-43be-b9e3-b55cc765278f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:11.517733 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecb562ae-9361-43be-b9e3-b55cc765278f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:11.518237 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecb562ae-9361-43be-b9e3-b55cc765278f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:11.518823 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecb562ae-9361-43be-b9e3-b55cc765278f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:11.527155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecb562ae-9361-43be-b9e3-b55cc765278f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:11.527155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecb562ae-9361-43be-b9e3-b55cc765278f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:11.527155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecb562ae-9361-43be-b9e3-b55cc765278f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:11.802280 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dbbdb138-644f-4c82-9ded-9edcd3d78c3a tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:11.802837 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-dbbdb138-644f-4c82-9ded-9edcd3d78c3a tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:11.814491 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dbbdb138-644f-4c82-9ded-9edcd3d78c3a tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:11.815374 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dbbdb138-644f-4c82-9ded-9edcd3d78c3a tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:11.816007 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dbbdb138-644f-4c82-9ded-9edcd3d78c3a tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:11.817056 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dbbdb138-644f-4c82-9ded-9edcd3d78c3a tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:11.817725 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dbbdb138-644f-4c82-9ded-9edcd3d78c3a tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:11.818557 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dbbdb138-644f-4c82-9ded-9edcd3d78c3a tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:11.828466 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ecb562ae-9361-43be-b9e3-b55cc765278f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:11.848550 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ecb562ae-9361-43be-b9e3-b55cc765278f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:11.854050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ecb562ae-9361-43be-b9e3-b55cc765278f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:11.855485 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ecb562ae-9361-43be-b9e3-b55cc765278f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1721 microversion: 2.20 time: 0.350510 Sep 27 16:39:11.856098 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 171/332] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:11 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1721 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:12.065032 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dbbdb138-644f-4c82-9ded-9edcd3d78c3a tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:12.075545 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-dbbdb138-644f-4c82-9ded-9edcd3d78c3a tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1358 microversion: 2.1 time: 0.277395 Sep 27 16:39:12.076893 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 162/333] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:11 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1358 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:39:12.354470 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ecc03624-0883-44d4-803d-5fe8d0bf6966 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:12.355791 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ecc03624-0883-44d4-803d-5fe8d0bf6966 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:12.362505 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3bacbfcb-7602-4b9f-969a-db1597b5fadb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:12.362694 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecc03624-0883-44d4-803d-5fe8d0bf6966 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:12.363439 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecc03624-0883-44d4-803d-5fe8d0bf6966 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:12.363581 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3bacbfcb-7602-4b9f-969a-db1597b5fadb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:12.364227 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecc03624-0883-44d4-803d-5fe8d0bf6966 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:12.365179 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecc03624-0883-44d4-803d-5fe8d0bf6966 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:12.365846 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecc03624-0883-44d4-803d-5fe8d0bf6966 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:12.366488 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecc03624-0883-44d4-803d-5fe8d0bf6966 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:12.373076 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3bacbfcb-7602-4b9f-969a-db1597b5fadb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:12.373574 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3bacbfcb-7602-4b9f-969a-db1597b5fadb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:12.374013 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3bacbfcb-7602-4b9f-969a-db1597b5fadb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:12.374838 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3bacbfcb-7602-4b9f-969a-db1597b5fadb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:12.375300 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3bacbfcb-7602-4b9f-969a-db1597b5fadb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:12.375723 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3bacbfcb-7602-4b9f-969a-db1597b5fadb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:12.592128 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3bacbfcb-7602-4b9f-969a-db1597b5fadb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:12.606018 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3bacbfcb-7602-4b9f-969a-db1597b5fadb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.245205 Sep 27 16:39:12.609300 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 163/334] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:12 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:39:12.639404 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ecc03624-0883-44d4-803d-5fe8d0bf6966 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:12.648340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ecc03624-0883-44d4-803d-5fe8d0bf6966 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 200 len: 1312 microversion: 2.1 time: 0.298670 Sep 27 16:39:12.649129 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 172/335] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:12 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 1312 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:12.893257 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-774a454a-dfeb-4388-9734-1b4fae8c7e4d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:12.894757 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-774a454a-dfeb-4388-9734-1b4fae8c7e4d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:12.901754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-774a454a-dfeb-4388-9734-1b4fae8c7e4d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:12.902232 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-774a454a-dfeb-4388-9734-1b4fae8c7e4d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:12.902660 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-774a454a-dfeb-4388-9734-1b4fae8c7e4d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:12.903562 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-774a454a-dfeb-4388-9734-1b4fae8c7e4d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:12.904014 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-774a454a-dfeb-4388-9734-1b4fae8c7e4d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:12.904426 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-774a454a-dfeb-4388-9734-1b4fae8c7e4d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:13.079216 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-774a454a-dfeb-4388-9734-1b4fae8c7e4d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:13.099276 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ff50d52b-091d-43a8-9bf2-6ba52dff4ef0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:13.100074 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ff50d52b-091d-43a8-9bf2-6ba52dff4ef0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:13.105087 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-774a454a-dfeb-4388-9734-1b4fae8c7e4d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:13.107640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff50d52b-091d-43a8-9bf2-6ba52dff4ef0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:13.108409 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff50d52b-091d-43a8-9bf2-6ba52dff4ef0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:13.109062 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff50d52b-091d-43a8-9bf2-6ba52dff4ef0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:13.109993 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff50d52b-091d-43a8-9bf2-6ba52dff4ef0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:13.110930 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff50d52b-091d-43a8-9bf2-6ba52dff4ef0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:13.111651 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff50d52b-091d-43a8-9bf2-6ba52dff4ef0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:13.115852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-774a454a-dfeb-4388-9734-1b4fae8c7e4d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:13.121864 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-774a454a-dfeb-4388-9734-1b4fae8c7e4d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1721 microversion: 2.20 time: 0.237731 Sep 27 16:39:13.124330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 164/336] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:12 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:39:13.317255 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ff50d52b-091d-43a8-9bf2-6ba52dff4ef0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:13.327639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ff50d52b-091d-43a8-9bf2-6ba52dff4ef0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1358 microversion: 2.1 time: 0.232186 Sep 27 16:39:13.342800 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 173/337] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:13 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:13.632208 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b119a845-4d70-4b9f-8227-7e8a4aaa3abd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:13.632829 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b119a845-4d70-4b9f-8227-7e8a4aaa3abd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:13.638978 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b119a845-4d70-4b9f-8227-7e8a4aaa3abd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:13.639458 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b119a845-4d70-4b9f-8227-7e8a4aaa3abd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:13.639893 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b119a845-4d70-4b9f-8227-7e8a4aaa3abd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:13.640588 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b119a845-4d70-4b9f-8227-7e8a4aaa3abd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:13.641035 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b119a845-4d70-4b9f-8227-7e8a4aaa3abd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:13.641452 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b119a845-4d70-4b9f-8227-7e8a4aaa3abd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:13.674372 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-60d314b6-1ede-4805-b959-4fedfa01615e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:13.676450 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-60d314b6-1ede-4805-b959-4fedfa01615e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:13.684008 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-60d314b6-1ede-4805-b959-4fedfa01615e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:13.684658 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-60d314b6-1ede-4805-b959-4fedfa01615e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:13.685227 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-60d314b6-1ede-4805-b959-4fedfa01615e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:13.686066 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-60d314b6-1ede-4805-b959-4fedfa01615e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:13.686617 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-60d314b6-1ede-4805-b959-4fedfa01615e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:13.687289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-60d314b6-1ede-4805-b959-4fedfa01615e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:13.877261 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b119a845-4d70-4b9f-8227-7e8a4aaa3abd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:13.899613 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b119a845-4d70-4b9f-8227-7e8a4aaa3abd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.271446 Sep 27 16:39:13.900194 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 165/338] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:13 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:13.963234 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-60d314b6-1ede-4805-b959-4fedfa01615e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:13.973312 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-60d314b6-1ede-4805-b959-4fedfa01615e tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 200 len: 1312 microversion: 2.1 time: 0.304321 Sep 27 16:39:13.973874 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 174/339] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:13 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 1312 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:39:14.152989 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ef5f6917-5c8e-446a-8644-d9d3164d0ca9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:14.153840 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ef5f6917-5c8e-446a-8644-d9d3164d0ca9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:14.167896 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef5f6917-5c8e-446a-8644-d9d3164d0ca9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:14.178590 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef5f6917-5c8e-446a-8644-d9d3164d0ca9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:14.179168 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef5f6917-5c8e-446a-8644-d9d3164d0ca9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:14.180028 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef5f6917-5c8e-446a-8644-d9d3164d0ca9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:14.180612 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef5f6917-5c8e-446a-8644-d9d3164d0ca9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:14.181158 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef5f6917-5c8e-446a-8644-d9d3164d0ca9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:14.351673 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e98d2d93-e9ab-48b4-bda1-c433b942f9c0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:14.352820 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e98d2d93-e9ab-48b4-bda1-c433b942f9c0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:14.354374 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ef5f6917-5c8e-446a-8644-d9d3164d0ca9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:14.359319 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e98d2d93-e9ab-48b4-bda1-c433b942f9c0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:14.359987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e98d2d93-e9ab-48b4-bda1-c433b942f9c0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:14.360577 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e98d2d93-e9ab-48b4-bda1-c433b942f9c0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:14.363405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e98d2d93-e9ab-48b4-bda1-c433b942f9c0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:14.363532 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ef5f6917-5c8e-446a-8644-d9d3164d0ca9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:14.373647 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ef5f6917-5c8e-446a-8644-d9d3164d0ca9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:14.373647 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ef5f6917-5c8e-446a-8644-d9d3164d0ca9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1721 microversion: 2.20 time: 0.226451 Sep 27 16:39:14.377337 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 166/340] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:14 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:14.386521 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e98d2d93-e9ab-48b4-bda1-c433b942f9c0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:14.387661 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e98d2d93-e9ab-48b4-bda1-c433b942f9c0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:14.552200 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e98d2d93-e9ab-48b4-bda1-c433b942f9c0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:14.555411 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e98d2d93-e9ab-48b4-bda1-c433b942f9c0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1358 microversion: 2.1 time: 0.207536 Sep 27 16:39:14.572552 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 175/341] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:14 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:39:14.938617 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-febb5c90-9c01-4080-b0b8-39d8219600b7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:14.939395 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-febb5c90-9c01-4080-b0b8-39d8219600b7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:14.948234 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-febb5c90-9c01-4080-b0b8-39d8219600b7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:14.948934 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-febb5c90-9c01-4080-b0b8-39d8219600b7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:14.949377 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-febb5c90-9c01-4080-b0b8-39d8219600b7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:14.950093 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-febb5c90-9c01-4080-b0b8-39d8219600b7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:14.950549 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-febb5c90-9c01-4080-b0b8-39d8219600b7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:14.950993 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-febb5c90-9c01-4080-b0b8-39d8219600b7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:15.096994 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-febb5c90-9c01-4080-b0b8-39d8219600b7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:15.109250 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-febb5c90-9c01-4080-b0b8-39d8219600b7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.175028 Sep 27 16:39:15.110884 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 167/342] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:14 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:15.116895 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-60816bbb-1074-43e1-83b3-f368367df0d6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:15.117693 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-60816bbb-1074-43e1-83b3-f368367df0d6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:15.124477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60816bbb-1074-43e1-83b3-f368367df0d6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:15.124962 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60816bbb-1074-43e1-83b3-f368367df0d6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:15.125726 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60816bbb-1074-43e1-83b3-f368367df0d6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:15.133024 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60816bbb-1074-43e1-83b3-f368367df0d6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:15.133852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60816bbb-1074-43e1-83b3-f368367df0d6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:15.134458 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60816bbb-1074-43e1-83b3-f368367df0d6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:15.172106 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-13d1e30e-8e11-43b2-af7d-63a74847a5ff tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Action: 'create', calling method: .version_select at 0x7fa405c945e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-878616145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbBHHwyC7E7MzRGS5OtxqePzBG8Za8gzCQnmrlvAPl1W1RsYq2r1FXB4NKCdxYWZUm/AhUBKyfa3322Z9j/aXFxz73uf8mJ6FLqkGhuHXfXWM2h6g8VNj/mHZ4UTXWYEA=="}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:15.192789 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-13d1e30e-8e11-43b2-af7d-63a74847a5ff tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Getting quotas for project 1e0f894b53284e788cdb4864acd917be. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:39:15.197466 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-13d1e30e-8e11-43b2-af7d-63a74847a5ff tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Getting quotas for user 421aaa238a3c495096dfc55aba76267c and project 1e0f894b53284e788cdb4864acd917be. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:39:15.295341 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-13d1e30e-8e11-43b2-af7d-63a74847a5ff tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.345988 Sep 27 16:39:15.296375 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 176/343] 10.222.0.64 () {60 vars in 1159 bytes} [Tue Sep 27 16:39:14 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:39:15.304994 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-60816bbb-1074-43e1-83b3-f368367df0d6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:15.315302 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-60816bbb-1074-43e1-83b3-f368367df0d6 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 200 len: 1312 microversion: 2.1 time: 0.202901 Sep 27 16:39:15.316554 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 168/344] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:15 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 1312 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:15.406850 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7e8207c1-e309-4fca-b910-e378419b9a72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:15.407468 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7e8207c1-e309-4fca-b910-e378419b9a72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:15.413907 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e8207c1-e309-4fca-b910-e378419b9a72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:15.414392 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e8207c1-e309-4fca-b910-e378419b9a72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:15.414863 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e8207c1-e309-4fca-b910-e378419b9a72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:15.416234 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e8207c1-e309-4fca-b910-e378419b9a72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:15.416691 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e8207c1-e309-4fca-b910-e378419b9a72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:15.417115 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e8207c1-e309-4fca-b910-e378419b9a72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:15.578314 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7e8207c1-e309-4fca-b910-e378419b9a72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:15.585304 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-51fda895-ca96-4307-bb6e-5811f0fdefc8 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:15.586829 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-51fda895-ca96-4307-bb6e-5811f0fdefc8 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:15.591938 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7e8207c1-e309-4fca-b910-e378419b9a72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:15.594114 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7e8207c1-e309-4fca-b910-e378419b9a72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:15.596911 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7e8207c1-e309-4fca-b910-e378419b9a72 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1721 microversion: 2.20 time: 0.197825 Sep 27 16:39:15.597847 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 177/345] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:15 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:15.617374 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-51fda895-ca96-4307-bb6e-5811f0fdefc8 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:15.619736 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-51fda895-ca96-4307-bb6e-5811f0fdefc8 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:15.620071 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-51fda895-ca96-4307-bb6e-5811f0fdefc8 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:15.620986 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-51fda895-ca96-4307-bb6e-5811f0fdefc8 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:15.621459 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-51fda895-ca96-4307-bb6e-5811f0fdefc8 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:15.621881 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-51fda895-ca96-4307-bb6e-5811f0fdefc8 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:15.826631 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-51fda895-ca96-4307-bb6e-5811f0fdefc8 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:15.838452 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-51fda895-ca96-4307-bb6e-5811f0fdefc8 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1358 microversion: 2.1 time: 0.263194 Sep 27 16:39:15.840737 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 169/346] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:15 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:16.138028 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cd512064-76f7-4753-9d3f-f2854d4aacde tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:16.138643 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cd512064-76f7-4753-9d3f-f2854d4aacde tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:16.144701 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd512064-76f7-4753-9d3f-f2854d4aacde tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:16.145191 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd512064-76f7-4753-9d3f-f2854d4aacde tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:16.145654 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd512064-76f7-4753-9d3f-f2854d4aacde tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:16.146350 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd512064-76f7-4753-9d3f-f2854d4aacde tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:16.146837 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd512064-76f7-4753-9d3f-f2854d4aacde tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:16.152736 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd512064-76f7-4753-9d3f-f2854d4aacde tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:16.304810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cd512064-76f7-4753-9d3f-f2854d4aacde tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:16.317828 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cd512064-76f7-4753-9d3f-f2854d4aacde tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.183892 Sep 27 16:39:16.318573 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 178/347] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:16 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:16.347991 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-99186459-2f12-48ee-99e6-8c9261e04d0f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:16.348785 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-99186459-2f12-48ee-99e6-8c9261e04d0f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:16.357743 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99186459-2f12-48ee-99e6-8c9261e04d0f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:16.358515 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99186459-2f12-48ee-99e6-8c9261e04d0f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:16.359162 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99186459-2f12-48ee-99e6-8c9261e04d0f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:16.360366 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99186459-2f12-48ee-99e6-8c9261e04d0f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:16.360984 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99186459-2f12-48ee-99e6-8c9261e04d0f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:16.362016 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99186459-2f12-48ee-99e6-8c9261e04d0f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:16.513988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-99186459-2f12-48ee-99e6-8c9261e04d0f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:16.522951 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-99186459-2f12-48ee-99e6-8c9261e04d0f tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 200 len: 1312 microversion: 2.1 time: 0.181438 Sep 27 16:39:16.524780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 170/348] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:16 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 1312 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:16.628958 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-afdf41d3-14f5-47d4-9cd8-c1a5d6da3558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:16.629683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-afdf41d3-14f5-47d4-9cd8-c1a5d6da3558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:16.636050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afdf41d3-14f5-47d4-9cd8-c1a5d6da3558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:16.636585 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afdf41d3-14f5-47d4-9cd8-c1a5d6da3558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:16.637022 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afdf41d3-14f5-47d4-9cd8-c1a5d6da3558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:16.637725 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afdf41d3-14f5-47d4-9cd8-c1a5d6da3558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:16.638181 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afdf41d3-14f5-47d4-9cd8-c1a5d6da3558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:16.638608 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afdf41d3-14f5-47d4-9cd8-c1a5d6da3558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:16.781920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-afdf41d3-14f5-47d4-9cd8-c1a5d6da3558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:16.793478 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-afdf41d3-14f5-47d4-9cd8-c1a5d6da3558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:16.795312 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-afdf41d3-14f5-47d4-9cd8-c1a5d6da3558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:16.796886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-afdf41d3-14f5-47d4-9cd8-c1a5d6da3558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1724 microversion: 2.20 time: 0.172457 Sep 27 16:39:16.798909 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 179/349] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:16 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:16.824966 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-63aac0c0-35a2-4686-b74a-4bd63a6982b0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec273422-5303-4c7b-8048-66c6d34f55b7"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:16.828037 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-63aac0c0-35a2-4686-b74a-4bd63a6982b0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:16.835332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63aac0c0-35a2-4686-b74a-4bd63a6982b0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:16.836079 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63aac0c0-35a2-4686-b74a-4bd63a6982b0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:16.837045 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63aac0c0-35a2-4686-b74a-4bd63a6982b0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:16.838863 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63aac0c0-35a2-4686-b74a-4bd63a6982b0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:16.839679 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63aac0c0-35a2-4686-b74a-4bd63a6982b0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:16.840343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-63aac0c0-35a2-4686-b74a-4bd63a6982b0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:16.862860 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7dd9952b-4884-4a15-b868-c6e84c30f39e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:16.863713 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7dd9952b-4884-4a15-b868-c6e84c30f39e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:16.871392 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7dd9952b-4884-4a15-b868-c6e84c30f39e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:16.871877 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7dd9952b-4884-4a15-b868-c6e84c30f39e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:16.872310 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7dd9952b-4884-4a15-b868-c6e84c30f39e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:16.873008 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7dd9952b-4884-4a15-b868-c6e84c30f39e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:16.873462 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7dd9952b-4884-4a15-b868-c6e84c30f39e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:16.874045 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7dd9952b-4884-4a15-b868-c6e84c30f39e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:17.086895 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7dd9952b-4884-4a15-b868-c6e84c30f39e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:17.095901 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7dd9952b-4884-4a15-b868-c6e84c30f39e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1358 microversion: 2.1 time: 0.237786 Sep 27 16:39:17.112916 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 180/350] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:16 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:17.148712 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-b50dfaa1-7185-4b84-9497-b4c75e198389 req-ab7f6231-6b0f-412e-b266-9f655df98078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54bed735-4766-4b93-9db9-4c3731eec6c7", "name": "network-vif-plugged", "status": "completed", "tag": "95614818-7cd1-4590-9696-e7a8c3f6a751"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:17.172372 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b50dfaa1-7185-4b84-9497-b4c75e198389 req-ab7f6231-6b0f-412e-b266-9f655df98078 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:17.172855 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b50dfaa1-7185-4b84-9497-b4c75e198389 req-ab7f6231-6b0f-412e-b266-9f655df98078 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:17.173289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b50dfaa1-7185-4b84-9497-b4c75e198389 req-ab7f6231-6b0f-412e-b266-9f655df98078 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:17.185272 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-b50dfaa1-7185-4b84-9497-b4c75e198389 req-ab7f6231-6b0f-412e-b266-9f655df98078 service nova] Creating event network-vif-plugged:95614818-7cd1-4590-9696-e7a8c3f6a751 for instance 54bed735-4766-4b93-9db9-4c3731eec6c7 on hv-cinder-85506 Sep 27 16:39:17.190182 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-b50dfaa1-7185-4b84-9497-b4c75e198389 req-ab7f6231-6b0f-412e-b266-9f655df98078 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048442 Sep 27 16:39:17.190752 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 181/351] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:39:17.341409 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d27cf4f3-f581-406f-91e8-a811562571fe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:17.342106 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d27cf4f3-f581-406f-91e8-a811562571fe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:17.360607 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d27cf4f3-f581-406f-91e8-a811562571fe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:17.363071 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d27cf4f3-f581-406f-91e8-a811562571fe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:17.365094 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d27cf4f3-f581-406f-91e8-a811562571fe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:17.365999 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d27cf4f3-f581-406f-91e8-a811562571fe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:17.367432 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d27cf4f3-f581-406f-91e8-a811562571fe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:17.368810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d27cf4f3-f581-406f-91e8-a811562571fe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:17.539839 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d27cf4f3-f581-406f-91e8-a811562571fe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:17.553151 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d27cf4f3-f581-406f-91e8-a811562571fe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.215655 Sep 27 16:39:17.554285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 182/352] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:17 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:39:17.560907 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7e54578b-4e30-4b71-8a6a-ea6b0756cdea tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:17.562340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7e54578b-4e30-4b71-8a6a-ea6b0756cdea tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:17.570892 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e54578b-4e30-4b71-8a6a-ea6b0756cdea tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:17.571875 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e54578b-4e30-4b71-8a6a-ea6b0756cdea tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:17.572711 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e54578b-4e30-4b71-8a6a-ea6b0756cdea tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:17.573909 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e54578b-4e30-4b71-8a6a-ea6b0756cdea tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:17.574612 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e54578b-4e30-4b71-8a6a-ea6b0756cdea tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:17.575279 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e54578b-4e30-4b71-8a6a-ea6b0756cdea tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:17.777278 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7e54578b-4e30-4b71-8a6a-ea6b0756cdea tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:17.797741 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7e54578b-4e30-4b71-8a6a-ea6b0756cdea tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 200 len: 1496 microversion: 2.1 time: 0.242012 Sep 27 16:39:17.798338 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 183/353] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:17 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 1496 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:18.122386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fcf73360-b562-429b-955e-1d50a6ae58f3 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:18.123040 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fcf73360-b562-429b-955e-1d50a6ae58f3 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:18.129616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fcf73360-b562-429b-955e-1d50a6ae58f3 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:18.130119 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fcf73360-b562-429b-955e-1d50a6ae58f3 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:18.130537 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fcf73360-b562-429b-955e-1d50a6ae58f3 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:18.131261 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fcf73360-b562-429b-955e-1d50a6ae58f3 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:18.131714 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fcf73360-b562-429b-955e-1d50a6ae58f3 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:18.132134 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fcf73360-b562-429b-955e-1d50a6ae58f3 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:18.316284 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fcf73360-b562-429b-955e-1d50a6ae58f3 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:18.332704 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fcf73360-b562-429b-955e-1d50a6ae58f3 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1358 microversion: 2.1 time: 0.214528 Sep 27 16:39:18.333557 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 184/354] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:18 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:39:18.433481 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-63aac0c0-35a2-4686-b74a-4bd63a6982b0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "POST /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.613314 Sep 27 16:39:18.434100 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 171/355] 10.222.0.64 () {62 vars in 1364 bytes} [Tue Sep 27 16:39:16 2022] POST /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9/os-volume_attachments => generated 188 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 16:39:18.578834 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3037103e-e638-4705-b598-fb9d6aadb1bd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:18.579286 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3037103e-e638-4705-b598-fb9d6aadb1bd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:18.586668 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3037103e-e638-4705-b598-fb9d6aadb1bd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:18.587429 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3037103e-e638-4705-b598-fb9d6aadb1bd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:18.587970 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3037103e-e638-4705-b598-fb9d6aadb1bd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:18.588915 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3037103e-e638-4705-b598-fb9d6aadb1bd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:18.589393 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3037103e-e638-4705-b598-fb9d6aadb1bd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:18.589868 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3037103e-e638-4705-b598-fb9d6aadb1bd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:18.595483 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:18.652995 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bb37cda1-5900-4c2e-989d-b55571d218de tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:18.653599 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bb37cda1-5900-4c2e-989d-b55571d218de tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:18.660704 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb37cda1-5900-4c2e-989d-b55571d218de tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:18.661185 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb37cda1-5900-4c2e-989d-b55571d218de tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:18.661613 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb37cda1-5900-4c2e-989d-b55571d218de tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:18.662306 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb37cda1-5900-4c2e-989d-b55571d218de tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:18.662762 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb37cda1-5900-4c2e-989d-b55571d218de tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:18.663433 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb37cda1-5900-4c2e-989d-b55571d218de tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:18.744351 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bb37cda1-5900-4c2e-989d-b55571d218de tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127617) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 27 16:39:18.784939 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3037103e-e638-4705-b598-fb9d6aadb1bd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:18.794027 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3037103e-e638-4705-b598-fb9d6aadb1bd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.219422 Sep 27 16:39:18.795318 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 185/356] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:18 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:18.944595 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:18.997823 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e485c53e-1d2f-4ea5-a859-036289bcfbc5 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:18.999015 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e485c53e-1d2f-4ea5-a859-036289bcfbc5 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:19.005582 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e485c53e-1d2f-4ea5-a859-036289bcfbc5 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:19.012828 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e485c53e-1d2f-4ea5-a859-036289bcfbc5 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:19.012828 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e485c53e-1d2f-4ea5-a859-036289bcfbc5 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:19.012828 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e485c53e-1d2f-4ea5-a859-036289bcfbc5 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:19.012828 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e485c53e-1d2f-4ea5-a859-036289bcfbc5 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:19.013460 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e485c53e-1d2f-4ea5-a859-036289bcfbc5 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:19.037728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e485c53e-1d2f-4ea5-a859-036289bcfbc5 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 16:39:19.225214 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bb37cda1-5900-4c2e-989d-b55571d218de tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "POST /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9/action" status: 202 len: 0 microversion: 2.20 time: 0.576632 Sep 27 16:39:19.225833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 172/357] 10.222.0.64 () {62 vars in 1319 bytes} [Tue Sep 27 16:39:18 2022] POST /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9/action => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 27 16:39:19.235595 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-90064060-6781-4af1-b712-dc27ecc967f1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:19.236204 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-90064060-6781-4af1-b712-dc27ecc967f1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:19.242227 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90064060-6781-4af1-b712-dc27ecc967f1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:19.242727 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90064060-6781-4af1-b712-dc27ecc967f1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:19.243957 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90064060-6781-4af1-b712-dc27ecc967f1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:19.244690 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90064060-6781-4af1-b712-dc27ecc967f1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:19.245204 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90064060-6781-4af1-b712-dc27ecc967f1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:19.245579 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90064060-6781-4af1-b712-dc27ecc967f1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:19.390384 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-90064060-6781-4af1-b712-dc27ecc967f1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:19.400901 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e485c53e-1d2f-4ea5-a859-036289bcfbc5 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "DELETE /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 204 len: 0 microversion: 2.1 time: 0.405552 Sep 27 16:39:19.404458 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-90064060-6781-4af1-b712-dc27ecc967f1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:19.404721 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 186/358] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:39:18 2022] DELETE /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 16:39:19.404805 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-90064060-6781-4af1-b712-dc27ecc967f1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:19.404805 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-90064060-6781-4af1-b712-dc27ecc967f1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1750 microversion: 2.20 time: 0.172092 Sep 27 16:39:19.404805 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 173/359] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:19 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1750 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:19.419526 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3d30477b-7f9a-416e-b2e2-d55f9e591473 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:19.420244 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3d30477b-7f9a-416e-b2e2-d55f9e591473 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:19.427910 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-08b0768c-afad-4ea7-a8dd-e9accb8a21c7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:19.432844 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-08b0768c-afad-4ea7-a8dd-e9accb8a21c7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:19.436183 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-08b0768c-afad-4ea7-a8dd-e9accb8a21c7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:19.437017 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d30477b-7f9a-416e-b2e2-d55f9e591473 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:19.437440 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-08b0768c-afad-4ea7-a8dd-e9accb8a21c7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:19.437894 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d30477b-7f9a-416e-b2e2-d55f9e591473 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:19.438596 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-08b0768c-afad-4ea7-a8dd-e9accb8a21c7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:19.439348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-08b0768c-afad-4ea7-a8dd-e9accb8a21c7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:19.439807 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-08b0768c-afad-4ea7-a8dd-e9accb8a21c7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:19.440230 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-08b0768c-afad-4ea7-a8dd-e9accb8a21c7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:19.447156 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d30477b-7f9a-416e-b2e2-d55f9e591473 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:19.448078 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d30477b-7f9a-416e-b2e2-d55f9e591473 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:19.448803 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d30477b-7f9a-416e-b2e2-d55f9e591473 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:19.449206 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d30477b-7f9a-416e-b2e2-d55f9e591473 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:19.648703 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-08b0768c-afad-4ea7-a8dd-e9accb8a21c7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:19.658491 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-08b0768c-afad-4ea7-a8dd-e9accb8a21c7 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 200 len: 1502 microversion: 2.1 time: 0.238399 Sep 27 16:39:19.671595 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 174/360] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:19 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 1502 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:19.681506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3d30477b-7f9a-416e-b2e2-d55f9e591473 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:19.689858 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3d30477b-7f9a-416e-b2e2-d55f9e591473 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1358 microversion: 2.1 time: 0.286433 Sep 27 16:39:19.690437 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 187/361] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:19 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1358 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:19.820820 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c68bcf6c-04fe-4a9a-8b9c-07c31c7768ca tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:19.821517 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c68bcf6c-04fe-4a9a-8b9c-07c31c7768ca tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:19.839021 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c68bcf6c-04fe-4a9a-8b9c-07c31c7768ca tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:19.840415 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c68bcf6c-04fe-4a9a-8b9c-07c31c7768ca tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:19.840415 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c68bcf6c-04fe-4a9a-8b9c-07c31c7768ca tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:19.840808 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c68bcf6c-04fe-4a9a-8b9c-07c31c7768ca tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:19.841260 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c68bcf6c-04fe-4a9a-8b9c-07c31c7768ca tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:19.841682 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c68bcf6c-04fe-4a9a-8b9c-07c31c7768ca tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:20.001585 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c68bcf6c-04fe-4a9a-8b9c-07c31c7768ca tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:20.010278 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c68bcf6c-04fe-4a9a-8b9c-07c31c7768ca tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.193307 Sep 27 16:39:20.010863 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 175/362] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:19 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:20.435289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-264d5149-e483-4a7a-8707-f56c244fe10d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:20.435892 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-264d5149-e483-4a7a-8707-f56c244fe10d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:20.442138 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-264d5149-e483-4a7a-8707-f56c244fe10d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:20.442618 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-264d5149-e483-4a7a-8707-f56c244fe10d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:20.443077 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-264d5149-e483-4a7a-8707-f56c244fe10d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:20.443762 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-264d5149-e483-4a7a-8707-f56c244fe10d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:20.444220 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-264d5149-e483-4a7a-8707-f56c244fe10d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:20.444642 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-264d5149-e483-4a7a-8707-f56c244fe10d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:20.593934 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-264d5149-e483-4a7a-8707-f56c244fe10d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:20.604271 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-264d5149-e483-4a7a-8707-f56c244fe10d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:20.605913 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-264d5149-e483-4a7a-8707-f56c244fe10d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:20.607140 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-264d5149-e483-4a7a-8707-f56c244fe10d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1750 microversion: 2.20 time: 0.176590 Sep 27 16:39:20.607699 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 188/363] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:20 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:20.684114 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fbd42dd3-b9dd-48e5-ae7d-b8b53a21615b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:20.685839 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fbd42dd3-b9dd-48e5-ae7d-b8b53a21615b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:20.693354 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fbd42dd3-b9dd-48e5-ae7d-b8b53a21615b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:20.694033 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fbd42dd3-b9dd-48e5-ae7d-b8b53a21615b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:20.694464 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fbd42dd3-b9dd-48e5-ae7d-b8b53a21615b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:20.695363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fbd42dd3-b9dd-48e5-ae7d-b8b53a21615b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:20.695973 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fbd42dd3-b9dd-48e5-ae7d-b8b53a21615b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:20.698323 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fbd42dd3-b9dd-48e5-ae7d-b8b53a21615b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:20.712778 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3ebcde47-779b-4942-a599-c07c930e8ec0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:20.713421 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3ebcde47-779b-4942-a599-c07c930e8ec0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:20.719753 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ebcde47-779b-4942-a599-c07c930e8ec0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:20.720233 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ebcde47-779b-4942-a599-c07c930e8ec0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:20.720664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ebcde47-779b-4942-a599-c07c930e8ec0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:20.721356 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ebcde47-779b-4942-a599-c07c930e8ec0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:20.721809 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ebcde47-779b-4942-a599-c07c930e8ec0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:20.722262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ebcde47-779b-4942-a599-c07c930e8ec0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:20.894445 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fbd42dd3-b9dd-48e5-ae7d-b8b53a21615b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:20.902986 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fbd42dd3-b9dd-48e5-ae7d-b8b53a21615b tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 200 len: 1502 microversion: 2.1 time: 0.222781 Sep 27 16:39:20.903557 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 176/364] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:20 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 1502 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:20.909190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3ebcde47-779b-4942-a599-c07c930e8ec0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:20.919018 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3ebcde47-779b-4942-a599-c07c930e8ec0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1358 microversion: 2.1 time: 0.210749 Sep 27 16:39:20.922839 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 189/365] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:20 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:39:21.033452 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b24e780a-6b5a-4032-a4ae-a30b50d75d9c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:21.034082 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b24e780a-6b5a-4032-a4ae-a30b50d75d9c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:21.040367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b24e780a-6b5a-4032-a4ae-a30b50d75d9c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:21.040915 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b24e780a-6b5a-4032-a4ae-a30b50d75d9c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:21.041365 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b24e780a-6b5a-4032-a4ae-a30b50d75d9c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:21.042111 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b24e780a-6b5a-4032-a4ae-a30b50d75d9c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:21.042560 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b24e780a-6b5a-4032-a4ae-a30b50d75d9c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:21.042996 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b24e780a-6b5a-4032-a4ae-a30b50d75d9c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:21.174172 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b24e780a-6b5a-4032-a4ae-a30b50d75d9c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:21.181909 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b24e780a-6b5a-4032-a4ae-a30b50d75d9c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.152332 Sep 27 16:39:21.182468 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 177/366] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:21 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:21.635939 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-07fe8508-6615-40b8-9ce4-cf7c99f820ec tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:21.636551 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-07fe8508-6615-40b8-9ce4-cf7c99f820ec tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:21.642550 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07fe8508-6615-40b8-9ce4-cf7c99f820ec tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:21.643075 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07fe8508-6615-40b8-9ce4-cf7c99f820ec tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:21.643515 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07fe8508-6615-40b8-9ce4-cf7c99f820ec tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:21.644202 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07fe8508-6615-40b8-9ce4-cf7c99f820ec tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:21.644657 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07fe8508-6615-40b8-9ce4-cf7c99f820ec tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:21.645079 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07fe8508-6615-40b8-9ce4-cf7c99f820ec tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:21.775137 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-07fe8508-6615-40b8-9ce4-cf7c99f820ec tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:21.783646 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-07fe8508-6615-40b8-9ce4-cf7c99f820ec tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:21.785336 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-07fe8508-6615-40b8-9ce4-cf7c99f820ec tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:21.786471 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-07fe8508-6615-40b8-9ce4-cf7c99f820ec tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1750 microversion: 2.20 time: 0.155544 Sep 27 16:39:21.787051 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 190/367] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:21 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:21.928821 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-20b75b43-e1d6-42f6-b8c3-4132b0ffbd14 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:21.929424 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-20b75b43-e1d6-42f6-b8c3-4132b0ffbd14 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:21.936910 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-20b75b43-e1d6-42f6-b8c3-4132b0ffbd14 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:21.937391 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-20b75b43-e1d6-42f6-b8c3-4132b0ffbd14 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:21.937827 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-20b75b43-e1d6-42f6-b8c3-4132b0ffbd14 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:21.938512 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-20b75b43-e1d6-42f6-b8c3-4132b0ffbd14 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:21.938996 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-20b75b43-e1d6-42f6-b8c3-4132b0ffbd14 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:21.939413 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-20b75b43-e1d6-42f6-b8c3-4132b0ffbd14 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:21.946998 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6b5d9b7f-2e2e-4186-9986-03f5ad849bdf tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:21.947632 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6b5d9b7f-2e2e-4186-9986-03f5ad849bdf tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:21.953704 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b5d9b7f-2e2e-4186-9986-03f5ad849bdf tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:21.954191 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b5d9b7f-2e2e-4186-9986-03f5ad849bdf tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:21.954622 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b5d9b7f-2e2e-4186-9986-03f5ad849bdf tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:21.955431 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b5d9b7f-2e2e-4186-9986-03f5ad849bdf tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:21.955884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b5d9b7f-2e2e-4186-9986-03f5ad849bdf tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:21.956303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6b5d9b7f-2e2e-4186-9986-03f5ad849bdf tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:22.399460 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-20b75b43-e1d6-42f6-b8c3-4132b0ffbd14 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:22.404961 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6b5d9b7f-2e2e-4186-9986-03f5ad849bdf tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:22.408602 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-20b75b43-e1d6-42f6-b8c3-4132b0ffbd14 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 200 len: 1502 microversion: 2.1 time: 0.483362 Sep 27 16:39:22.409643 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 178/368] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:21 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 1502 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:22.414408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-11e9b464-d9fb-4f53-9d30-d488c32789ad tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:22.415052 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-11e9b464-d9fb-4f53-9d30-d488c32789ad tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:22.421799 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-11e9b464-d9fb-4f53-9d30-d488c32789ad tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:22.424026 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-11e9b464-d9fb-4f53-9d30-d488c32789ad tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:22.424026 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-11e9b464-d9fb-4f53-9d30-d488c32789ad tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:22.424026 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-11e9b464-d9fb-4f53-9d30-d488c32789ad tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:22.424711 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-11e9b464-d9fb-4f53-9d30-d488c32789ad tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:22.425142 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-11e9b464-d9fb-4f53-9d30-d488c32789ad tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:22.433843 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6b5d9b7f-2e2e-4186-9986-03f5ad849bdf tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1549 microversion: 2.1 time: 0.490338 Sep 27 16:39:22.435013 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 191/369] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:21 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1549 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:39:22.464642 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-aa991e19-b5e1-4e38-8096-2cb52d5216a4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:22.465284 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-aa991e19-b5e1-4e38-8096-2cb52d5216a4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:22.471304 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa991e19-b5e1-4e38-8096-2cb52d5216a4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:22.471790 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa991e19-b5e1-4e38-8096-2cb52d5216a4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:22.472222 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa991e19-b5e1-4e38-8096-2cb52d5216a4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:22.472946 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa991e19-b5e1-4e38-8096-2cb52d5216a4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:22.473396 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa991e19-b5e1-4e38-8096-2cb52d5216a4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:22.473812 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa991e19-b5e1-4e38-8096-2cb52d5216a4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:22.620896 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-11e9b464-d9fb-4f53-9d30-d488c32789ad tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:22.629592 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-11e9b464-d9fb-4f53-9d30-d488c32789ad tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.218589 Sep 27 16:39:22.633529 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 179/370] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:22 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:22.679018 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-aa991e19-b5e1-4e38-8096-2cb52d5216a4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:22.695273 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-aa991e19-b5e1-4e38-8096-2cb52d5216a4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1549 microversion: 2.1 time: 0.235242 Sep 27 16:39:22.708305 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 192/371] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:22 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1549 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:22.721327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-66af40d5-be54-4d84-a9d6-46473f308bf7 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:22.726450 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-66af40d5-be54-4d84-a9d6-46473f308bf7 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:22.727382 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-66af40d5-be54-4d84-a9d6-46473f308bf7 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Searching by: {'deleted': False, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3'} {{(pid=127617) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 16:39:22.734978 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66af40d5-be54-4d84-a9d6-46473f308bf7 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:22.735608 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66af40d5-be54-4d84-a9d6-46473f308bf7 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:22.736143 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66af40d5-be54-4d84-a9d6-46473f308bf7 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:22.736942 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66af40d5-be54-4d84-a9d6-46473f308bf7 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:22.737602 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66af40d5-be54-4d84-a9d6-46473f308bf7 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:22.738090 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66af40d5-be54-4d84-a9d6-46473f308bf7 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:22.757972 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-bcc57317-616c-4c15-8ad7-c023b6d973f1 req-b9c0124a-86a3-4bfd-a414-a45c226b421e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b13caeb-5d84-44a8-bfaa-fb75150bec2f", "name": "network-vif-deleted", "tag": "f7d376fe-e5b1-4dc1-9503-bd20dcb08471"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:22.781259 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-bcc57317-616c-4c15-8ad7-c023b6d973f1 req-b9c0124a-86a3-4bfd-a414-a45c226b421e service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:22.782453 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-bcc57317-616c-4c15-8ad7-c023b6d973f1 req-b9c0124a-86a3-4bfd-a414-a45c226b421e service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:22.783160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-bcc57317-616c-4c15-8ad7-c023b6d973f1 req-b9c0124a-86a3-4bfd-a414-a45c226b421e service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:22.797003 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-bcc57317-616c-4c15-8ad7-c023b6d973f1 req-b9c0124a-86a3-4bfd-a414-a45c226b421e service nova] Creating event network-vif-deleted:f7d376fe-e5b1-4dc1-9503-bd20dcb08471 for instance 2b13caeb-5d84-44a8-bfaa-fb75150bec2f on hv-cinder-85506 Sep 27 16:39:22.803297 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-bcc57317-616c-4c15-8ad7-c023b6d973f1 req-b9c0124a-86a3-4bfd-a414-a45c226b421e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048926 Sep 27 16:39:22.804463 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 193/372] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:39:22.824934 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cd2b4e13-6166-4308-8f78-48da889fe196 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:22.826131 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cd2b4e13-6166-4308-8f78-48da889fe196 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:22.828295 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:22.834114 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd2b4e13-6166-4308-8f78-48da889fe196 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:22.834919 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd2b4e13-6166-4308-8f78-48da889fe196 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:22.835432 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd2b4e13-6166-4308-8f78-48da889fe196 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:22.836204 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd2b4e13-6166-4308-8f78-48da889fe196 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:22.836737 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd2b4e13-6166-4308-8f78-48da889fe196 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:22.837231 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd2b4e13-6166-4308-8f78-48da889fe196 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:22.839726 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.multi_cell_list [None req-66af40d5-be54-4d84-a9d6-46473f308bf7 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127617) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 16:39:22.942969 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-66af40d5-be54-4d84-a9d6-46473f308bf7 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.226938 Sep 27 16:39:22.943689 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 180/373] 10.222.0.64 () {58 vars in 1125 bytes} [Tue Sep 27 16:39:22 2022] GET /compute/v2.1/servers => generated 343 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:39:22.955882 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a0a575b0-0cc0-474b-9bb5-dec87cbdfa44 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:22.956490 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a0a575b0-0cc0-474b-9bb5-dec87cbdfa44 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:22.962504 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0a575b0-0cc0-474b-9bb5-dec87cbdfa44 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:22.962748 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0a575b0-0cc0-474b-9bb5-dec87cbdfa44 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:22.965221 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0a575b0-0cc0-474b-9bb5-dec87cbdfa44 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:22.965221 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0a575b0-0cc0-474b-9bb5-dec87cbdfa44 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:22.965221 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0a575b0-0cc0-474b-9bb5-dec87cbdfa44 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:22.965221 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0a575b0-0cc0-474b-9bb5-dec87cbdfa44 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:22.997705 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cd2b4e13-6166-4308-8f78-48da889fe196 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:23.012912 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cd2b4e13-6166-4308-8f78-48da889fe196 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:23.014791 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cd2b4e13-6166-4308-8f78-48da889fe196 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:23.016189 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cd2b4e13-6166-4308-8f78-48da889fe196 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1752 microversion: 2.20 time: 0.207065 Sep 27 16:39:23.017585 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 194/374] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:22 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1752 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:23.119587 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a0a575b0-0cc0-474b-9bb5-dec87cbdfa44 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:23.133028 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a0a575b0-0cc0-474b-9bb5-dec87cbdfa44 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1549 microversion: 2.1 time: 0.180835 Sep 27 16:39:23.133617 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 181/375] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:22 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1549 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:39:23.436114 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0b014f6a-9e0c-4845-bffc-f22ec78772be tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:23.436951 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0b014f6a-9e0c-4845-bffc-f22ec78772be tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:23.445009 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0b014f6a-9e0c-4845-bffc-f22ec78772be tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:23.445500 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0b014f6a-9e0c-4845-bffc-f22ec78772be tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:23.445936 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0b014f6a-9e0c-4845-bffc-f22ec78772be tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:23.446821 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0b014f6a-9e0c-4845-bffc-f22ec78772be tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:23.448170 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0b014f6a-9e0c-4845-bffc-f22ec78772be tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:23.448800 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0b014f6a-9e0c-4845-bffc-f22ec78772be tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:23.484105 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0b014f6a-9e0c-4845-bffc-f22ec78772be tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:23.484594 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0b014f6a-9e0c-4845-bffc-f22ec78772be tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:23.485025 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0b014f6a-9e0c-4845-bffc-f22ec78772be tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:23.485472 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-0b014f6a-9e0c-4845-bffc-f22ec78772be tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lazy-loading 'fault' on Instance uuid 2b13caeb-5d84-44a8-bfaa-fb75150bec2f {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:39:23.536057 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0b014f6a-9e0c-4845-bffc-f22ec78772be tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e32dbc314d4953b3e3c21cbb481367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54a4b85dba3b48b68e25c190b98b6197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:23.549408 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0b014f6a-9e0c-4845-bffc-f22ec78772be tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 200 len: 1302 microversion: 2.1 time: 0.112723 Sep 27 16:39:23.549408 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 195/376] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:23 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 1302 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:23.657682 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d3536411-511e-4eb6-bf86-a1086e73ea9f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:23.658313 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d3536411-511e-4eb6-bf86-a1086e73ea9f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:23.667114 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d3536411-511e-4eb6-bf86-a1086e73ea9f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:23.667603 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d3536411-511e-4eb6-bf86-a1086e73ea9f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:23.668032 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d3536411-511e-4eb6-bf86-a1086e73ea9f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:23.668732 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d3536411-511e-4eb6-bf86-a1086e73ea9f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:23.669181 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d3536411-511e-4eb6-bf86-a1086e73ea9f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:23.669599 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d3536411-511e-4eb6-bf86-a1086e73ea9f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:23.812102 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d3536411-511e-4eb6-bf86-a1086e73ea9f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:23.822122 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d3536411-511e-4eb6-bf86-a1086e73ea9f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.170484 Sep 27 16:39:23.823389 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 182/377] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:23 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:24.045768 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2d5f5e3f-a96c-49ab-b8b5-e406b94a8f9e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:24.046414 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2d5f5e3f-a96c-49ab-b8b5-e406b94a8f9e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:24.052517 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d5f5e3f-a96c-49ab-b8b5-e406b94a8f9e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:24.053009 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d5f5e3f-a96c-49ab-b8b5-e406b94a8f9e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:24.053452 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d5f5e3f-a96c-49ab-b8b5-e406b94a8f9e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:24.054166 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d5f5e3f-a96c-49ab-b8b5-e406b94a8f9e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:24.054627 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d5f5e3f-a96c-49ab-b8b5-e406b94a8f9e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:24.055091 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d5f5e3f-a96c-49ab-b8b5-e406b94a8f9e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:24.192314 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2d5f5e3f-a96c-49ab-b8b5-e406b94a8f9e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:24.201386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2d5f5e3f-a96c-49ab-b8b5-e406b94a8f9e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:24.202898 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2d5f5e3f-a96c-49ab-b8b5-e406b94a8f9e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:24.204057 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2d5f5e3f-a96c-49ab-b8b5-e406b94a8f9e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1752 microversion: 2.20 time: 0.163032 Sep 27 16:39:24.204680 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 196/378] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:24 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:24.572398 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-72cb7d7d-64fe-4af1-af3d-a6f947dc4546 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:24.573486 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-72cb7d7d-64fe-4af1-af3d-a6f947dc4546 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] [instance: 2b13caeb-5d84-44a8-bfaa-fb75150bec2f] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:24.580642 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-72cb7d7d-64fe-4af1-af3d-a6f947dc4546 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:24.581161 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-72cb7d7d-64fe-4af1-af3d-a6f947dc4546 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:24.581669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-72cb7d7d-64fe-4af1-af3d-a6f947dc4546 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:24.582451 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-72cb7d7d-64fe-4af1-af3d-a6f947dc4546 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:24.583035 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-72cb7d7d-64fe-4af1-af3d-a6f947dc4546 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:24.583556 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-72cb7d7d-64fe-4af1-af3d-a6f947dc4546 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:24.607510 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-72cb7d7d-64fe-4af1-af3d-a6f947dc4546 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] HTTP exception thrown: Instance 2b13caeb-5d84-44a8-bfaa-fb75150bec2f could not be found. Sep 27 16:39:24.610463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-72cb7d7d-64fe-4af1-af3d-a6f947dc4546 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Request method failure captured: Sep 27 16:39:24.610463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f HTTP/1.1 Sep 27 16:39:24.610463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:39:24.610463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:39:24.610463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:39:24.610463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 27 16:39:24.610463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:39:24.610463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:39:24.610463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:39:24.610463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:39:24.610463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMybx3wFLSk6UmXCwU0IFC8RvyHH7Rh_JbhieDC_mpSCTnVX9l1NK_LAing15GDusoprLdeeaA2JzPwnwpH6wABa3cycGO0I1SvN-aWTZGuxJq4B-E8vdMK1XLlxh5KHuSfKLnsFUTMYD7vPHooneJU3xEJvI-cStAhhA4lvNgOdBr6U Sep 27 16:39:24.610463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:39:24.610463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:39:24.610463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:39:24.610463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:39:24.610463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:39:24.610463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:39:24.610463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: 54a4b85dba3b48b68e25c190b98b6197 Sep 27 16:39:24.610463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesActionsTest-1202937359 Sep 27 16:39:24.610463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:39:24.610463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:39:24.612086 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/54a4b85dba3b48b68e25c190b98b6197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_54a4b85dba3b48b68e25c190b98b6197"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/54a4b85dba3b48b68e25c190b98b6197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/54a4b85dba3b48b68e25c190b98b6197"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:39:24.612086 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesActionsTest-1202937359 Sep 27 16:39:24.612086 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 54a4b85dba3b48b68e25c190b98b6197 Sep 27 16:39:24.612086 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesActionsTest-1202937359 Sep 27 16:39:24.612086 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesActionsTest-1202937359-project Sep 27 16:39:24.612086 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:39:24.612086 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:39:24.612086 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: f7e32dbc314d4953b3e3c21cbb481367 Sep 27 16:39:24.612086 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesActionsTest-1202937359-project Sep 27 16:39:24.612086 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: > Sep 27 16:39:24.612086 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Instance 2b13caeb-5d84-44a8-bfaa-fb75150bec2f could not be found. Sep 27 16:39:24.612086 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'id': '2b13caeb-5d84-44a8-bfaa-fb75150bec2f'} Sep 27 16:39:24.613330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:39:24.613330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:39:24.613330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:39:24.613330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:39:24.613330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:39:24.613330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:39:24.613330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:39:24.613330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:39:24.613330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:39:24.613330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:39:24.613330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b13caeb-5d84-44a8-bfaa-fb75150bec2f could not be found. Sep 27 16:39:24.613330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:39:24.613330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:39:24.613330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:39:24.613330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:39:24.613330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:39:24.613330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:39:24.613330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:39:24.613330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:39:24.613330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:39:24.615007 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:39:24.615007 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:39:24.615007 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:39:24.615007 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:39:24.615007 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:39:24.615007 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:39:24.615007 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:39:24.615007 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b13caeb-5d84-44a8-bfaa-fb75150bec2f could not be found. Sep 27 16:39:24.615007 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:39:24.615007 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:39:24.615007 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:39:24.615007 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:39:24.615007 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:39:24.615007 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:39:24.615007 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:39:24.615007 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:39:24.615007 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b13caeb-5d84-44a8-bfaa-fb75150bec2f could not be found. Sep 27 16:39:24.615007 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:39:24.616281 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-72cb7d7d-64fe-4af1-af3d-a6f947dc4546 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] Returning 404 to user: Instance 2b13caeb-5d84-44a8-bfaa-fb75150bec2f could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:39:24.616281 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-72cb7d7d-64fe-4af1-af3d-a6f947dc4546 tempest-VolumesActionsTest-1202937359 tempest-VolumesActionsTest-1202937359-project] 10.222.0.64 "GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f" status: 404 len: 111 microversion: 2.1 time: 0.044097 Sep 27 16:39:24.616281 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 183/379] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:24 2022] GET /compute/v2.1/servers/2b13caeb-5d84-44a8-bfaa-fb75150bec2f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:39:24.845516 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6e499295-537b-4266-9552-6f15b8fe1b81 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:24.846236 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6e499295-537b-4266-9552-6f15b8fe1b81 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:24.852266 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e499295-537b-4266-9552-6f15b8fe1b81 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:24.852756 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e499295-537b-4266-9552-6f15b8fe1b81 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:24.853255 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e499295-537b-4266-9552-6f15b8fe1b81 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:24.854763 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e499295-537b-4266-9552-6f15b8fe1b81 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:24.855242 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e499295-537b-4266-9552-6f15b8fe1b81 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:24.855745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e499295-537b-4266-9552-6f15b8fe1b81 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:25.022759 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6e499295-537b-4266-9552-6f15b8fe1b81 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:25.031684 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6e499295-537b-4266-9552-6f15b8fe1b81 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.190137 Sep 27 16:39:25.032245 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 197/380] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:24 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:25.219052 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0a2ac3be-5b56-4801-802c-1ae8b7e491f1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ea51b63-250a-46c9-89d9-c5fd775311ca"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:25.221477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0a2ac3be-5b56-4801-802c-1ae8b7e491f1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:25.227500 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0a2ac3be-5b56-4801-802c-1ae8b7e491f1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:25.228037 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0a2ac3be-5b56-4801-802c-1ae8b7e491f1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:25.228411 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0a2ac3be-5b56-4801-802c-1ae8b7e491f1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:25.229389 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0a2ac3be-5b56-4801-802c-1ae8b7e491f1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:25.229843 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0a2ac3be-5b56-4801-802c-1ae8b7e491f1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:25.229953 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f1bfb033-90a9-46e9-91b6-f07178dd438f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:25.230376 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0a2ac3be-5b56-4801-802c-1ae8b7e491f1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:25.230479 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f1bfb033-90a9-46e9-91b6-f07178dd438f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:25.232946 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=4 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:25.238015 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1bfb033-90a9-46e9-91b6-f07178dd438f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:25.238701 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1bfb033-90a9-46e9-91b6-f07178dd438f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:25.239366 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1bfb033-90a9-46e9-91b6-f07178dd438f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:25.240260 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1bfb033-90a9-46e9-91b6-f07178dd438f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:25.241015 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1bfb033-90a9-46e9-91b6-f07178dd438f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:25.241587 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1bfb033-90a9-46e9-91b6-f07178dd438f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:25.411713 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f1bfb033-90a9-46e9-91b6-f07178dd438f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:25.422821 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f1bfb033-90a9-46e9-91b6-f07178dd438f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:25.424350 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f1bfb033-90a9-46e9-91b6-f07178dd438f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:25.425528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f1bfb033-90a9-46e9-91b6-f07178dd438f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.200081 Sep 27 16:39:25.427553 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 198/381] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:25 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:39:26.055162 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-150348f1-9f19-4e47-8485-71506c21f8fa tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:26.057197 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-150348f1-9f19-4e47-8485-71506c21f8fa tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:26.064608 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-150348f1-9f19-4e47-8485-71506c21f8fa tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:26.065446 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-150348f1-9f19-4e47-8485-71506c21f8fa tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:26.066908 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-150348f1-9f19-4e47-8485-71506c21f8fa tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:26.067689 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-150348f1-9f19-4e47-8485-71506c21f8fa tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:26.068220 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-150348f1-9f19-4e47-8485-71506c21f8fa tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:26.068852 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-150348f1-9f19-4e47-8485-71506c21f8fa tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:26.073444 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0a2ac3be-5b56-4801-802c-1ae8b7e491f1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "POST /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.857079 Sep 27 16:39:26.074381 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 184/382] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Sep 27 16:39:25 2022] POST /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7/os-volume_attachments => generated 194 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:39:26.179087 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dfea81e8-9777-46eb-a32d-a2dc7675d34a tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04e28c92-e1c6-434c-bed6-aed81e71ef52", "device": "/dev/sdb"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:26.183308 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-dfea81e8-9777-46eb-a32d-a2dc7675d34a tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:26.190265 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfea81e8-9777-46eb-a32d-a2dc7675d34a tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:26.190824 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfea81e8-9777-46eb-a32d-a2dc7675d34a tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:26.191261 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfea81e8-9777-46eb-a32d-a2dc7675d34a tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:26.191986 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfea81e8-9777-46eb-a32d-a2dc7675d34a tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:26.192447 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfea81e8-9777-46eb-a32d-a2dc7675d34a tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:26.192843 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfea81e8-9777-46eb-a32d-a2dc7675d34a tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:26.249083 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-150348f1-9f19-4e47-8485-71506c21f8fa tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:26.256860 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-150348f1-9f19-4e47-8485-71506c21f8fa tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.205768 Sep 27 16:39:26.257423 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 199/383] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:26 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:39:26.451892 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a6ab2e75-4ddd-4658-99fe-58fe9979bcd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:26.452502 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a6ab2e75-4ddd-4658-99fe-58fe9979bcd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:26.458434 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6ab2e75-4ddd-4658-99fe-58fe9979bcd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:26.458956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6ab2e75-4ddd-4658-99fe-58fe9979bcd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:26.459453 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6ab2e75-4ddd-4658-99fe-58fe9979bcd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:26.460147 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6ab2e75-4ddd-4658-99fe-58fe9979bcd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:26.460604 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6ab2e75-4ddd-4658-99fe-58fe9979bcd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:26.461030 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6ab2e75-4ddd-4658-99fe-58fe9979bcd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:26.479514 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:26.589084 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a6ab2e75-4ddd-4658-99fe-58fe9979bcd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:26.597533 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a6ab2e75-4ddd-4658-99fe-58fe9979bcd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:26.598959 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a6ab2e75-4ddd-4658-99fe-58fe9979bcd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:26.600117 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a6ab2e75-4ddd-4658-99fe-58fe9979bcd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.152235 Sep 27 16:39:26.600673 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 200/384] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:26 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:39:27.280143 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5f2bddf9-1b89-434d-b439-5ea20e92eb8a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:27.280739 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5f2bddf9-1b89-434d-b439-5ea20e92eb8a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:27.287509 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f2bddf9-1b89-434d-b439-5ea20e92eb8a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:27.288024 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f2bddf9-1b89-434d-b439-5ea20e92eb8a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:27.288442 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f2bddf9-1b89-434d-b439-5ea20e92eb8a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:27.289149 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f2bddf9-1b89-434d-b439-5ea20e92eb8a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:27.289608 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f2bddf9-1b89-434d-b439-5ea20e92eb8a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:27.290045 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f2bddf9-1b89-434d-b439-5ea20e92eb8a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:27.427646 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5f2bddf9-1b89-434d-b439-5ea20e92eb8a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:27.435342 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5f2bddf9-1b89-434d-b439-5ea20e92eb8a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.159546 Sep 27 16:39:27.435897 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 201/385] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:27 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:39:27.626054 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4e9c64b9-83f4-4da2-8e5b-023ff9681da0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:27.626600 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4e9c64b9-83f4-4da2-8e5b-023ff9681da0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:27.632566 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e9c64b9-83f4-4da2-8e5b-023ff9681da0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:27.633043 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e9c64b9-83f4-4da2-8e5b-023ff9681da0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:27.633471 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e9c64b9-83f4-4da2-8e5b-023ff9681da0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:27.634151 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e9c64b9-83f4-4da2-8e5b-023ff9681da0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:27.634598 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e9c64b9-83f4-4da2-8e5b-023ff9681da0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:27.635048 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4e9c64b9-83f4-4da2-8e5b-023ff9681da0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:27.768981 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4e9c64b9-83f4-4da2-8e5b-023ff9681da0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:27.778165 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4e9c64b9-83f4-4da2-8e5b-023ff9681da0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:27.779696 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4e9c64b9-83f4-4da2-8e5b-023ff9681da0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:27.780854 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4e9c64b9-83f4-4da2-8e5b-023ff9681da0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.158762 Sep 27 16:39:27.781413 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 202/386] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:27 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:39:28.457447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-46547fba-6560-4255-a8a0-c2cd59539d4c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:28.458076 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-46547fba-6560-4255-a8a0-c2cd59539d4c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:28.463974 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46547fba-6560-4255-a8a0-c2cd59539d4c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:28.464457 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46547fba-6560-4255-a8a0-c2cd59539d4c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:28.464893 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46547fba-6560-4255-a8a0-c2cd59539d4c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:28.465583 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46547fba-6560-4255-a8a0-c2cd59539d4c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:28.466034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46547fba-6560-4255-a8a0-c2cd59539d4c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:28.466465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46547fba-6560-4255-a8a0-c2cd59539d4c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:28.602880 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-46547fba-6560-4255-a8a0-c2cd59539d4c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:28.611371 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-46547fba-6560-4255-a8a0-c2cd59539d4c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.157805 Sep 27 16:39:28.611940 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 203/387] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:28 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:39:28.805804 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-63178f30-db9a-42e7-83c8-168868aad3e7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:28.806333 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-63178f30-db9a-42e7-83c8-168868aad3e7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:28.813063 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63178f30-db9a-42e7-83c8-168868aad3e7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:28.813561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63178f30-db9a-42e7-83c8-168868aad3e7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:28.814001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63178f30-db9a-42e7-83c8-168868aad3e7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:28.814713 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63178f30-db9a-42e7-83c8-168868aad3e7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:28.815196 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63178f30-db9a-42e7-83c8-168868aad3e7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:28.815621 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63178f30-db9a-42e7-83c8-168868aad3e7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:28.953606 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-63178f30-db9a-42e7-83c8-168868aad3e7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:28.962253 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-63178f30-db9a-42e7-83c8-168868aad3e7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:28.964175 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-63178f30-db9a-42e7-83c8-168868aad3e7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:28.965314 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-63178f30-db9a-42e7-83c8-168868aad3e7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.163671 Sep 27 16:39:28.965866 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 204/388] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:28 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:39:29.634668 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9a90879a-ccab-48ca-9c68-7088f4b80409 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:29.635924 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9a90879a-ccab-48ca-9c68-7088f4b80409 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:29.642003 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a90879a-ccab-48ca-9c68-7088f4b80409 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:29.642542 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a90879a-ccab-48ca-9c68-7088f4b80409 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:29.643020 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a90879a-ccab-48ca-9c68-7088f4b80409 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:29.643766 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a90879a-ccab-48ca-9c68-7088f4b80409 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:29.644221 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a90879a-ccab-48ca-9c68-7088f4b80409 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:29.644647 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a90879a-ccab-48ca-9c68-7088f4b80409 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:29.772052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9a90879a-ccab-48ca-9c68-7088f4b80409 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:29.779945 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9a90879a-ccab-48ca-9c68-7088f4b80409 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.149147 Sep 27 16:39:29.781901 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 205/389] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:29 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:39:29.991845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a78ee480-6038-43d2-928c-837e3864940e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:29.992455 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a78ee480-6038-43d2-928c-837e3864940e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:30.000371 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a78ee480-6038-43d2-928c-837e3864940e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:30.001261 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a78ee480-6038-43d2-928c-837e3864940e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:30.002225 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a78ee480-6038-43d2-928c-837e3864940e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:30.002979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a78ee480-6038-43d2-928c-837e3864940e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:30.003827 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a78ee480-6038-43d2-928c-837e3864940e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:30.004347 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a78ee480-6038-43d2-928c-837e3864940e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:30.160780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a78ee480-6038-43d2-928c-837e3864940e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:30.177779 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a78ee480-6038-43d2-928c-837e3864940e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:30.181115 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a78ee480-6038-43d2-928c-837e3864940e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:30.185800 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a78ee480-6038-43d2-928c-837e3864940e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.197885 Sep 27 16:39:30.186436 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 206/390] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:29 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:39:30.804176 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-71754802-1e33-4e3b-8229-5e6489ba42bc tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:30.805852 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-71754802-1e33-4e3b-8229-5e6489ba42bc tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:30.813613 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71754802-1e33-4e3b-8229-5e6489ba42bc tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:30.814391 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71754802-1e33-4e3b-8229-5e6489ba42bc tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:30.815112 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71754802-1e33-4e3b-8229-5e6489ba42bc tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:30.815991 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71754802-1e33-4e3b-8229-5e6489ba42bc tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:30.816625 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71754802-1e33-4e3b-8229-5e6489ba42bc tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:30.817288 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71754802-1e33-4e3b-8229-5e6489ba42bc tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:31.046927 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-71754802-1e33-4e3b-8229-5e6489ba42bc tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:31.046927 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-71754802-1e33-4e3b-8229-5e6489ba42bc tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.230019 Sep 27 16:39:31.046927 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 207/391] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:30 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:39:31.214475 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0e72ece4-92d6-48f8-8cf8-7b2ea49e9324 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:31.215213 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0e72ece4-92d6-48f8-8cf8-7b2ea49e9324 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:31.221423 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e72ece4-92d6-48f8-8cf8-7b2ea49e9324 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:31.221912 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e72ece4-92d6-48f8-8cf8-7b2ea49e9324 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:31.222347 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e72ece4-92d6-48f8-8cf8-7b2ea49e9324 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:31.223090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e72ece4-92d6-48f8-8cf8-7b2ea49e9324 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:31.223565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e72ece4-92d6-48f8-8cf8-7b2ea49e9324 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:31.224242 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0e72ece4-92d6-48f8-8cf8-7b2ea49e9324 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:31.389568 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0e72ece4-92d6-48f8-8cf8-7b2ea49e9324 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:31.404210 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0e72ece4-92d6-48f8-8cf8-7b2ea49e9324 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:31.405668 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0e72ece4-92d6-48f8-8cf8-7b2ea49e9324 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:31.406938 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0e72ece4-92d6-48f8-8cf8-7b2ea49e9324 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.197080 Sep 27 16:39:31.407680 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 208/392] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:31 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:39:31.649497 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-dfea81e8-9777-46eb-a32d-a2dc7675d34a tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "POST /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.475583 Sep 27 16:39:31.650166 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 185/393] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Sep 27 16:39:26 2022] POST /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab/os-volume_attachments => generated 194 bytes in 5477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:39:32.055341 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5acec034-1f17-44a9-8314-d62c5c84d529 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:32.056061 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5acec034-1f17-44a9-8314-d62c5c84d529 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:32.065163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5acec034-1f17-44a9-8314-d62c5c84d529 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:32.065980 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5acec034-1f17-44a9-8314-d62c5c84d529 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:32.066657 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5acec034-1f17-44a9-8314-d62c5c84d529 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:32.067653 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5acec034-1f17-44a9-8314-d62c5c84d529 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:32.068391 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5acec034-1f17-44a9-8314-d62c5c84d529 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:32.069040 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5acec034-1f17-44a9-8314-d62c5c84d529 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:32.231958 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5acec034-1f17-44a9-8314-d62c5c84d529 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:32.239944 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5acec034-1f17-44a9-8314-d62c5c84d529 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.189693 Sep 27 16:39:32.240510 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 209/394] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:32 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:32.435458 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2d3a18d2-d872-4414-ac32-8e6e4f68b427 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:32.436397 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2d3a18d2-d872-4414-ac32-8e6e4f68b427 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:32.445984 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2d3a18d2-d872-4414-ac32-8e6e4f68b427 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:32.446817 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2d3a18d2-d872-4414-ac32-8e6e4f68b427 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:32.447467 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2d3a18d2-d872-4414-ac32-8e6e4f68b427 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:32.448922 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2d3a18d2-d872-4414-ac32-8e6e4f68b427 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:32.449573 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2d3a18d2-d872-4414-ac32-8e6e4f68b427 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:32.450214 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2d3a18d2-d872-4414-ac32-8e6e4f68b427 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:32.598257 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2d3a18d2-d872-4414-ac32-8e6e4f68b427 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:32.602960 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:32.609524 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2d3a18d2-d872-4414-ac32-8e6e4f68b427 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:32.610989 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2d3a18d2-d872-4414-ac32-8e6e4f68b427 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:32.623542 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2d3a18d2-d872-4414-ac32-8e6e4f68b427 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.182205 Sep 27 16:39:32.623542 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 186/395] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:32 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:39:33.266583 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2d04d1ec-109a-4390-a4db-aacd081dbbd4 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:33.267947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2d04d1ec-109a-4390-a4db-aacd081dbbd4 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:33.274237 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d04d1ec-109a-4390-a4db-aacd081dbbd4 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:33.274729 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d04d1ec-109a-4390-a4db-aacd081dbbd4 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:33.275192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d04d1ec-109a-4390-a4db-aacd081dbbd4 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:33.275895 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d04d1ec-109a-4390-a4db-aacd081dbbd4 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:33.276913 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d04d1ec-109a-4390-a4db-aacd081dbbd4 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:33.277494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d04d1ec-109a-4390-a4db-aacd081dbbd4 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:33.416951 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2d04d1ec-109a-4390-a4db-aacd081dbbd4 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:33.425103 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2d04d1ec-109a-4390-a4db-aacd081dbbd4 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.162397 Sep 27 16:39:33.431729 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 210/396] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:33 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:33.638932 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-08059405-a0e7-47f1-bf37-a3ac8c5328b5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:33.639545 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-08059405-a0e7-47f1-bf37-a3ac8c5328b5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:33.641327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:33.647044 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-08059405-a0e7-47f1-bf37-a3ac8c5328b5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:33.647520 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-08059405-a0e7-47f1-bf37-a3ac8c5328b5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:33.647945 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-08059405-a0e7-47f1-bf37-a3ac8c5328b5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:33.648801 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-08059405-a0e7-47f1-bf37-a3ac8c5328b5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:33.649253 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-08059405-a0e7-47f1-bf37-a3ac8c5328b5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:33.649718 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-08059405-a0e7-47f1-bf37-a3ac8c5328b5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:33.803410 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-08059405-a0e7-47f1-bf37-a3ac8c5328b5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:33.813004 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-08059405-a0e7-47f1-bf37-a3ac8c5328b5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:33.814459 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-08059405-a0e7-47f1-bf37-a3ac8c5328b5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:33.815662 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-08059405-a0e7-47f1-bf37-a3ac8c5328b5 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.181665 Sep 27 16:39:33.816226 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 187/397] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:33 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:34.452121 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a1ec77c7-0925-4926-8045-0307242628b5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:34.452850 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a1ec77c7-0925-4926-8045-0307242628b5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:34.459805 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a1ec77c7-0925-4926-8045-0307242628b5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:34.460296 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a1ec77c7-0925-4926-8045-0307242628b5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:34.460795 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a1ec77c7-0925-4926-8045-0307242628b5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:34.461576 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a1ec77c7-0925-4926-8045-0307242628b5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:34.462378 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a1ec77c7-0925-4926-8045-0307242628b5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:34.462459 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a1ec77c7-0925-4926-8045-0307242628b5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:34.707207 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a1ec77c7-0925-4926-8045-0307242628b5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:34.722789 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a1ec77c7-0925-4926-8045-0307242628b5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.277030 Sep 27 16:39:34.738808 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 211/398] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:34 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:34.842598 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-01cefe14-e6e3-4123-b496-fa3519714b71 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:34.889532 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-01cefe14-e6e3-4123-b496-fa3519714b71 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:34.889532 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-01cefe14-e6e3-4123-b496-fa3519714b71 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:34.889532 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-01cefe14-e6e3-4123-b496-fa3519714b71 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:34.889532 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-01cefe14-e6e3-4123-b496-fa3519714b71 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:34.890379 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-01cefe14-e6e3-4123-b496-fa3519714b71 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:34.890379 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-01cefe14-e6e3-4123-b496-fa3519714b71 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:34.890379 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-01cefe14-e6e3-4123-b496-fa3519714b71 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:35.065015 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-01cefe14-e6e3-4123-b496-fa3519714b71 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:35.077896 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-01cefe14-e6e3-4123-b496-fa3519714b71 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:35.080207 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-01cefe14-e6e3-4123-b496-fa3519714b71 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:35.082161 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-01cefe14-e6e3-4123-b496-fa3519714b71 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.244596 Sep 27 16:39:35.102361 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 188/399] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:34 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:35.753961 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5389e845-3397-4fab-93c3-b7bce8611a3f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:35.756002 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5389e845-3397-4fab-93c3-b7bce8611a3f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:35.768694 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5389e845-3397-4fab-93c3-b7bce8611a3f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:35.769622 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5389e845-3397-4fab-93c3-b7bce8611a3f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:35.770419 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5389e845-3397-4fab-93c3-b7bce8611a3f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:35.771438 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5389e845-3397-4fab-93c3-b7bce8611a3f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:35.772022 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5389e845-3397-4fab-93c3-b7bce8611a3f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:35.772649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5389e845-3397-4fab-93c3-b7bce8611a3f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:35.954952 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5389e845-3397-4fab-93c3-b7bce8611a3f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:35.965005 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5389e845-3397-4fab-93c3-b7bce8611a3f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.216034 Sep 27 16:39:35.966080 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 212/400] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:35 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:36.121418 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f514f9c6-0563-42e0-a96a-d6b9199e8bef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:36.122351 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f514f9c6-0563-42e0-a96a-d6b9199e8bef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:36.141859 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:36.143464 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f514f9c6-0563-42e0-a96a-d6b9199e8bef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:36.144204 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f514f9c6-0563-42e0-a96a-d6b9199e8bef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:36.144865 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f514f9c6-0563-42e0-a96a-d6b9199e8bef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:36.145806 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f514f9c6-0563-42e0-a96a-d6b9199e8bef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:36.146659 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f514f9c6-0563-42e0-a96a-d6b9199e8bef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:36.147331 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f514f9c6-0563-42e0-a96a-d6b9199e8bef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:36.396518 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f514f9c6-0563-42e0-a96a-d6b9199e8bef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:36.408562 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f514f9c6-0563-42e0-a96a-d6b9199e8bef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:36.411755 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f514f9c6-0563-42e0-a96a-d6b9199e8bef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:36.413913 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f514f9c6-0563-42e0-a96a-d6b9199e8bef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.306873 Sep 27 16:39:36.415583 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 189/401] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:36 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:36.992096 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2d2beef3-6f76-4a48-8b9f-4dae7d79d630 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:36.993441 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2d2beef3-6f76-4a48-8b9f-4dae7d79d630 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:37.001240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d2beef3-6f76-4a48-8b9f-4dae7d79d630 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:37.002326 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d2beef3-6f76-4a48-8b9f-4dae7d79d630 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:37.002730 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d2beef3-6f76-4a48-8b9f-4dae7d79d630 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:37.003670 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d2beef3-6f76-4a48-8b9f-4dae7d79d630 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:37.004315 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d2beef3-6f76-4a48-8b9f-4dae7d79d630 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:37.005079 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d2beef3-6f76-4a48-8b9f-4dae7d79d630 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:37.162404 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2d2beef3-6f76-4a48-8b9f-4dae7d79d630 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:37.175148 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2d2beef3-6f76-4a48-8b9f-4dae7d79d630 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.186489 Sep 27 16:39:37.176241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 213/402] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:36 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:37.447608 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4d343906-1d95-4863-bfac-428b4a1e0d26 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:37.450282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4d343906-1d95-4863-bfac-428b4a1e0d26 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:37.467705 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d343906-1d95-4863-bfac-428b4a1e0d26 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:37.468337 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d343906-1d95-4863-bfac-428b4a1e0d26 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:37.468790 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d343906-1d95-4863-bfac-428b4a1e0d26 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:37.469502 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d343906-1d95-4863-bfac-428b4a1e0d26 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:37.469964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d343906-1d95-4863-bfac-428b4a1e0d26 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:37.470388 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d343906-1d95-4863-bfac-428b4a1e0d26 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:37.723436 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4d343906-1d95-4863-bfac-428b4a1e0d26 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:37.739097 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4d343906-1d95-4863-bfac-428b4a1e0d26 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:37.740691 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4d343906-1d95-4863-bfac-428b4a1e0d26 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:37.742195 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4d343906-1d95-4863-bfac-428b4a1e0d26 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.299263 Sep 27 16:39:37.742940 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 190/403] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:37 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:38.199986 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-af0b9534-97dd-4db0-85e0-0cfe5d367451 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:38.201629 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-af0b9534-97dd-4db0-85e0-0cfe5d367451 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:38.208894 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-af0b9534-97dd-4db0-85e0-0cfe5d367451 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:38.209516 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-af0b9534-97dd-4db0-85e0-0cfe5d367451 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:38.210039 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-af0b9534-97dd-4db0-85e0-0cfe5d367451 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:38.211028 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-af0b9534-97dd-4db0-85e0-0cfe5d367451 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:38.211583 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-af0b9534-97dd-4db0-85e0-0cfe5d367451 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:38.212193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-af0b9534-97dd-4db0-85e0-0cfe5d367451 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:38.391342 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-af0b9534-97dd-4db0-85e0-0cfe5d367451 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:38.400576 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-af0b9534-97dd-4db0-85e0-0cfe5d367451 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.205976 Sep 27 16:39:38.401504 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 214/404] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:38 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:38.771795 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b4fcba85-75fe-44f2-beb3-b993ad433e3c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:38.772467 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b4fcba85-75fe-44f2-beb3-b993ad433e3c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:38.785236 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4fcba85-75fe-44f2-beb3-b993ad433e3c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:38.785742 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4fcba85-75fe-44f2-beb3-b993ad433e3c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:38.786173 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4fcba85-75fe-44f2-beb3-b993ad433e3c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:38.788633 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4fcba85-75fe-44f2-beb3-b993ad433e3c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:38.789118 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4fcba85-75fe-44f2-beb3-b993ad433e3c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:38.789546 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4fcba85-75fe-44f2-beb3-b993ad433e3c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:39.007555 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b4fcba85-75fe-44f2-beb3-b993ad433e3c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:39.020775 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b4fcba85-75fe-44f2-beb3-b993ad433e3c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:39.022708 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b4fcba85-75fe-44f2-beb3-b993ad433e3c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:39.024468 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b4fcba85-75fe-44f2-beb3-b993ad433e3c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.257174 Sep 27 16:39:39.025261 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 191/405] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:38 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:39.425130 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6cb08167-168b-47a7-920d-e93a466e0d2a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:39.425733 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6cb08167-168b-47a7-920d-e93a466e0d2a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:39.442298 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6cb08167-168b-47a7-920d-e93a466e0d2a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:39.443178 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6cb08167-168b-47a7-920d-e93a466e0d2a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:39.443832 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6cb08167-168b-47a7-920d-e93a466e0d2a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:39.444738 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6cb08167-168b-47a7-920d-e93a466e0d2a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:39.445379 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6cb08167-168b-47a7-920d-e93a466e0d2a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:39.446013 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6cb08167-168b-47a7-920d-e93a466e0d2a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:39.779981 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6cb08167-168b-47a7-920d-e93a466e0d2a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:39.779981 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6cb08167-168b-47a7-920d-e93a466e0d2a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.323076 Sep 27 16:39:39.779981 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 215/406] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:39 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:40.055754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4df5ac7c-b658-492a-b735-7c136987184a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:40.056464 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4df5ac7c-b658-492a-b735-7c136987184a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:40.064048 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4df5ac7c-b658-492a-b735-7c136987184a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:40.065066 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4df5ac7c-b658-492a-b735-7c136987184a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:40.065436 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4df5ac7c-b658-492a-b735-7c136987184a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:40.066130 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4df5ac7c-b658-492a-b735-7c136987184a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:40.066577 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4df5ac7c-b658-492a-b735-7c136987184a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:40.067180 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4df5ac7c-b658-492a-b735-7c136987184a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:40.414054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4df5ac7c-b658-492a-b735-7c136987184a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:40.429020 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4df5ac7c-b658-492a-b735-7c136987184a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:40.439310 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4df5ac7c-b658-492a-b735-7c136987184a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:40.440949 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4df5ac7c-b658-492a-b735-7c136987184a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.390895 Sep 27 16:39:40.442258 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 192/407] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:40 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:40.813859 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cf231687-55f3-4e60-88ec-284ebc38c72c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:40.815100 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cf231687-55f3-4e60-88ec-284ebc38c72c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:40.821892 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf231687-55f3-4e60-88ec-284ebc38c72c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:40.826982 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf231687-55f3-4e60-88ec-284ebc38c72c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:40.828081 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf231687-55f3-4e60-88ec-284ebc38c72c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:40.829050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf231687-55f3-4e60-88ec-284ebc38c72c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:40.832640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf231687-55f3-4e60-88ec-284ebc38c72c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:40.832640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf231687-55f3-4e60-88ec-284ebc38c72c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:41.017160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cf231687-55f3-4e60-88ec-284ebc38c72c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:41.025431 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cf231687-55f3-4e60-88ec-284ebc38c72c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.217193 Sep 27 16:39:41.026162 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 216/408] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:40 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:41.471615 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ddf68eac-3e3d-4d94-aa25-6899d5788bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:41.472190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ddf68eac-3e3d-4d94-aa25-6899d5788bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:41.479209 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ddf68eac-3e3d-4d94-aa25-6899d5788bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:41.479651 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ddf68eac-3e3d-4d94-aa25-6899d5788bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:41.480631 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ddf68eac-3e3d-4d94-aa25-6899d5788bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:41.480762 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ddf68eac-3e3d-4d94-aa25-6899d5788bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:41.481201 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ddf68eac-3e3d-4d94-aa25-6899d5788bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:41.481621 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ddf68eac-3e3d-4d94-aa25-6899d5788bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:41.649054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ddf68eac-3e3d-4d94-aa25-6899d5788bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:41.661750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ddf68eac-3e3d-4d94-aa25-6899d5788bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:41.663565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ddf68eac-3e3d-4d94-aa25-6899d5788bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:41.665193 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ddf68eac-3e3d-4d94-aa25-6899d5788bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.197477 Sep 27 16:39:41.666157 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 193/409] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:41 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:42.052588 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-df340c9f-fdf9-49f4-aabe-288e811a1845 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:42.053155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-df340c9f-fdf9-49f4-aabe-288e811a1845 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:42.059983 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df340c9f-fdf9-49f4-aabe-288e811a1845 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:42.060467 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df340c9f-fdf9-49f4-aabe-288e811a1845 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:42.060907 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df340c9f-fdf9-49f4-aabe-288e811a1845 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:42.061972 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df340c9f-fdf9-49f4-aabe-288e811a1845 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:42.062438 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df340c9f-fdf9-49f4-aabe-288e811a1845 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:42.063059 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df340c9f-fdf9-49f4-aabe-288e811a1845 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:42.067522 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:42.210500 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-df340c9f-fdf9-49f4-aabe-288e811a1845 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:42.221779 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-df340c9f-fdf9-49f4-aabe-288e811a1845 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.173189 Sep 27 16:39:42.233968 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 217/410] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:42 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:42.691496 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5c6308e1-a542-4d8b-a51a-0a6907d2b45e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:42.692165 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5c6308e1-a542-4d8b-a51a-0a6907d2b45e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:42.700053 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5c6308e1-a542-4d8b-a51a-0a6907d2b45e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:42.700712 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5c6308e1-a542-4d8b-a51a-0a6907d2b45e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:42.701961 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5c6308e1-a542-4d8b-a51a-0a6907d2b45e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:42.702659 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5c6308e1-a542-4d8b-a51a-0a6907d2b45e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:42.703293 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5c6308e1-a542-4d8b-a51a-0a6907d2b45e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:42.703716 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5c6308e1-a542-4d8b-a51a-0a6907d2b45e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:42.875360 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5c6308e1-a542-4d8b-a51a-0a6907d2b45e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:42.885252 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5c6308e1-a542-4d8b-a51a-0a6907d2b45e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:42.887039 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5c6308e1-a542-4d8b-a51a-0a6907d2b45e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:42.889778 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5c6308e1-a542-4d8b-a51a-0a6907d2b45e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.200927 Sep 27 16:39:42.889778 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 194/411] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:42 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:39:43.246694 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2f1fb42e-d3e4-45f7-9ce1-2fbbb05c2295 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:43.247352 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2f1fb42e-d3e4-45f7-9ce1-2fbbb05c2295 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:43.254496 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f1fb42e-d3e4-45f7-9ce1-2fbbb05c2295 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:43.255133 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f1fb42e-d3e4-45f7-9ce1-2fbbb05c2295 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:43.255946 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f1fb42e-d3e4-45f7-9ce1-2fbbb05c2295 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:43.256749 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f1fb42e-d3e4-45f7-9ce1-2fbbb05c2295 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:43.257392 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f1fb42e-d3e4-45f7-9ce1-2fbbb05c2295 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:43.258058 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f1fb42e-d3e4-45f7-9ce1-2fbbb05c2295 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:43.404642 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2f1fb42e-d3e4-45f7-9ce1-2fbbb05c2295 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:43.422221 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2f1fb42e-d3e4-45f7-9ce1-2fbbb05c2295 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1503 microversion: 2.1 time: 0.180021 Sep 27 16:39:43.422727 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 218/412] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:43 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:43.446807 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a1bec4b9-7d21-4dc6-9a95-6e7a7ab0fcbb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d941fab-1d53-4934-94e0-adca0d3c6195"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:43.450320 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a1bec4b9-7d21-4dc6-9a95-6e7a7ab0fcbb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:43.459008 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a1bec4b9-7d21-4dc6-9a95-6e7a7ab0fcbb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:43.459933 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a1bec4b9-7d21-4dc6-9a95-6e7a7ab0fcbb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:43.460591 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a1bec4b9-7d21-4dc6-9a95-6e7a7ab0fcbb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:43.461485 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a1bec4b9-7d21-4dc6-9a95-6e7a7ab0fcbb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:43.461943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a1bec4b9-7d21-4dc6-9a95-6e7a7ab0fcbb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:43.463129 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a1bec4b9-7d21-4dc6-9a95-6e7a7ab0fcbb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:43.494070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-a1bec4b9-7d21-4dc6-9a95-6e7a7ab0fcbb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] HTTP exception thrown: Cannot 'attach_volume' instance 35d1f4b1-f536-4f56-8c18-400be343444b while it is in vm_state rescued Sep 27 16:39:43.495733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a1bec4b9-7d21-4dc6-9a95-6e7a7ab0fcbb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Request method failure captured: Sep 27 16:39:43.495733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: POST /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b/os-volume_attachments HTTP/1.1 Sep 27 16:39:43.495733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:39:43.495733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:39:43.495733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:39:43.495733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 74 Sep 27 16:39:43.495733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:39:43.495733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:39:43.495733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:39:43.495733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:39:43.495733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMybbp91lepYQw85tUquWCV9UR5RezmQYrVfqE15tUFFE5y2X68s4nmn2P-J26dEvIkXNr6K7LpWu32utpxO1WVZFPVbAUVkBy8ED55Dss_89HF5N9IwPzLh5PE1Lkzf5zU-RvYh05UuJNz1vky_4nFLpZn78rK0k61y3SURPRT-cpXI Sep 27 16:39:43.495733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:39:43.495733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:39:43.495733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:39:43.495733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:39:43.495733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:39:43.495733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:39:43.495733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: 9288b4e62bc945479636aec307a98746 Sep 27 16:39:43.495733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-54837262 Sep 27 16:39:43.495733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:39:43.495733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:39:43.497176 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9288b4e62bc945479636aec307a98746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9288b4e62bc945479636aec307a98746"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9288b4e62bc945479636aec307a98746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9288b4e62bc945479636aec307a98746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:39:43.497176 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-ServerRescueNegativeTestJSON-54837262 Sep 27 16:39:43.497176 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 9288b4e62bc945479636aec307a98746 Sep 27 16:39:43.497176 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-54837262 Sep 27 16:39:43.497176 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-ServerRescueNegativeTestJSON-54837262-project Sep 27 16:39:43.497176 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:39:43.497176 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:39:43.497176 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: 2f9e55a3ff7c424dbd7a58f0eb92b8ce Sep 27 16:39:43.497176 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-ServerRescueNegativeTestJSON-54837262-project Sep 27 16:39:43.497176 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Sep 27 16:39:43.497176 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {"volumeAttachment": {"volumeId": "2d941fab-1d53-4934-94e0-adca0d3c6195"}} Sep 27 16:39:43.497176 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: > Sep 27 16:39:43.498342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Cannot 'attach_volume' instance 35d1f4b1-f536-4f56-8c18-400be343444b while it is in vm_state rescued Sep 27 16:39:43.498342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'server_id': '35d1f4b1-f536-4f56-8c18-400be343444b', 'body': {'volumeAttachment': {'volumeId': '2d941fab-1d53-4934-94e0-adca0d3c6195'}}} Sep 27 16:39:43.498342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:39:43.498342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:39:43.498342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 27 16:39:43.498342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 27 16:39:43.498342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 16:39:43.498342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 16:39:43.498342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 27 16:39:43.498342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 27 16:39:43.498342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 35d1f4b1-f536-4f56-8c18-400be343444b in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 27 16:39:43.498342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:39:43.498342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:39:43.498342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:39:43.498342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:39:43.498342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:39:43.498342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:39:43.498342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:39:43.498342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:39:43.499997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:39:43.499997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:39:43.499997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 16:39:43.499997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 16:39:43.499997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 16:39:43.499997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 16:39:43.499997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 16:39:43.499997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 16:39:43.499997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 27 16:39:43.499997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 27 16:39:43.499997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 27 16:39:43.499997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 27 16:39:43.499997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 35d1f4b1-f536-4f56-8c18-400be343444b while it is in vm_state rescued Sep 27 16:39:43.499997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:39:43.499997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:39:43.499997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:39:43.499997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:39:43.499997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:39:43.499997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:39:43.502230 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:39:43.502230 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:39:43.502230 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 35d1f4b1-f536-4f56-8c18-400be343444b while it is in vm_state rescued Sep 27 16:39:43.502230 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:39:43.502230 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a1bec4b9-7d21-4dc6-9a95-6e7a7ab0fcbb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Returning 409 to user: Cannot 'attach_volume' instance 35d1f4b1-f536-4f56-8c18-400be343444b while it is in vm_state rescued {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:39:43.508151 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a1bec4b9-7d21-4dc6-9a95-6e7a7ab0fcbb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "POST /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.065586 Sep 27 16:39:43.516157 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 195/413] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Sep 27 16:39:43 2022] POST /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b/os-volume_attachments => generated 152 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 27 16:39:43.524155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e14ec7de-1dcd-4cf4-b547-a4877d994eba tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:43.525494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e14ec7de-1dcd-4cf4-b547-a4877d994eba tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:43.534357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e14ec7de-1dcd-4cf4-b547-a4877d994eba tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:43.537205 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e14ec7de-1dcd-4cf4-b547-a4877d994eba tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:43.538293 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e14ec7de-1dcd-4cf4-b547-a4877d994eba tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:43.539440 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e14ec7de-1dcd-4cf4-b547-a4877d994eba tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:43.540064 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e14ec7de-1dcd-4cf4-b547-a4877d994eba tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:43.540476 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e14ec7de-1dcd-4cf4-b547-a4877d994eba tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:43.782101 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e14ec7de-1dcd-4cf4-b547-a4877d994eba tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "POST /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b/action" status: 202 len: 0 microversion: 2.1 time: 0.261564 Sep 27 16:39:43.782760 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 219/414] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Sep 27 16:39:43 2022] POST /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:39:43.794831 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3dece6b1-ec06-4448-9fa4-2bc65bac2e47 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:43.796401 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3dece6b1-ec06-4448-9fa4-2bc65bac2e47 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:43.805272 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3dece6b1-ec06-4448-9fa4-2bc65bac2e47 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:43.805828 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3dece6b1-ec06-4448-9fa4-2bc65bac2e47 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:43.806908 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3dece6b1-ec06-4448-9fa4-2bc65bac2e47 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:43.810127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3dece6b1-ec06-4448-9fa4-2bc65bac2e47 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:43.810674 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3dece6b1-ec06-4448-9fa4-2bc65bac2e47 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:43.812013 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3dece6b1-ec06-4448-9fa4-2bc65bac2e47 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:43.921001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6d58937f-29dd-4a2a-aa73-2edd11421f02 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:43.922027 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6d58937f-29dd-4a2a-aa73-2edd11421f02 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:43.933847 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6d58937f-29dd-4a2a-aa73-2edd11421f02 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:43.935056 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6d58937f-29dd-4a2a-aa73-2edd11421f02 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:43.936578 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6d58937f-29dd-4a2a-aa73-2edd11421f02 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:43.937903 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6d58937f-29dd-4a2a-aa73-2edd11421f02 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:43.938665 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6d58937f-29dd-4a2a-aa73-2edd11421f02 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:43.939240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6d58937f-29dd-4a2a-aa73-2edd11421f02 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:43.960792 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3dece6b1-ec06-4448-9fa4-2bc65bac2e47 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:43.972938 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3dece6b1-ec06-4448-9fa4-2bc65bac2e47 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1511 microversion: 2.1 time: 0.185318 Sep 27 16:39:43.987403 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 196/415] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:43 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1511 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:44.195294 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6d58937f-29dd-4a2a-aa73-2edd11421f02 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:44.209235 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6d58937f-29dd-4a2a-aa73-2edd11421f02 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:44.210720 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6d58937f-29dd-4a2a-aa73-2edd11421f02 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:44.211965 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6d58937f-29dd-4a2a-aa73-2edd11421f02 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.300444 Sep 27 16:39:44.212533 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 220/416] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:43 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:44.998897 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d02cdc4f-c0c8-40fc-8922-08fe97396fc0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:45.000278 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d02cdc4f-c0c8-40fc-8922-08fe97396fc0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:45.015570 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d02cdc4f-c0c8-40fc-8922-08fe97396fc0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:45.015570 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d02cdc4f-c0c8-40fc-8922-08fe97396fc0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:45.015570 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d02cdc4f-c0c8-40fc-8922-08fe97396fc0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:45.015570 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d02cdc4f-c0c8-40fc-8922-08fe97396fc0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:45.016270 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d02cdc4f-c0c8-40fc-8922-08fe97396fc0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:45.016270 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d02cdc4f-c0c8-40fc-8922-08fe97396fc0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:45.191104 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d02cdc4f-c0c8-40fc-8922-08fe97396fc0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:45.199142 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d02cdc4f-c0c8-40fc-8922-08fe97396fc0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1511 microversion: 2.1 time: 0.206090 Sep 27 16:39:45.200650 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 197/417] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:44 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:45.242157 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3593baa4-740c-4392-8ddd-f41dde333234 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:45.243490 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3593baa4-740c-4392-8ddd-f41dde333234 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:45.254769 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3593baa4-740c-4392-8ddd-f41dde333234 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:45.255549 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3593baa4-740c-4392-8ddd-f41dde333234 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:45.256144 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3593baa4-740c-4392-8ddd-f41dde333234 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:45.257170 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3593baa4-740c-4392-8ddd-f41dde333234 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:45.257793 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3593baa4-740c-4392-8ddd-f41dde333234 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:45.258539 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3593baa4-740c-4392-8ddd-f41dde333234 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:45.466446 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-954983af-fb34-4e66-a916-c7b64d4e9770 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:45.467319 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-954983af-fb34-4e66-a916-c7b64d4e9770 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:45.477399 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-954983af-fb34-4e66-a916-c7b64d4e9770 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:45.481137 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-954983af-fb34-4e66-a916-c7b64d4e9770 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:45.481999 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-954983af-fb34-4e66-a916-c7b64d4e9770 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:45.483139 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-954983af-fb34-4e66-a916-c7b64d4e9770 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:45.484858 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-954983af-fb34-4e66-a916-c7b64d4e9770 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:45.487291 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-954983af-fb34-4e66-a916-c7b64d4e9770 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:45.540154 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3593baa4-740c-4392-8ddd-f41dde333234 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:45.563045 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3593baa4-740c-4392-8ddd-f41dde333234 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:45.564664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3593baa4-740c-4392-8ddd-f41dde333234 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:45.565918 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3593baa4-740c-4392-8ddd-f41dde333234 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.328947 Sep 27 16:39:45.568861 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 221/418] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:45 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:45.701559 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-954983af-fb34-4e66-a916-c7b64d4e9770 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:45.711325 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-954983af-fb34-4e66-a916-c7b64d4e9770 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1595 microversion: 2.1 time: 0.248419 Sep 27 16:39:45.712423 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 198/419] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:45 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1595 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:39:46.225767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d9709326-9e0a-44c9-8fbf-05a9f1a9a190 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:46.227066 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d9709326-9e0a-44c9-8fbf-05a9f1a9a190 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:46.239005 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9709326-9e0a-44c9-8fbf-05a9f1a9a190 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:46.239870 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9709326-9e0a-44c9-8fbf-05a9f1a9a190 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:46.240543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9709326-9e0a-44c9-8fbf-05a9f1a9a190 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:46.241472 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9709326-9e0a-44c9-8fbf-05a9f1a9a190 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:46.242123 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9709326-9e0a-44c9-8fbf-05a9f1a9a190 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:46.242730 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9709326-9e0a-44c9-8fbf-05a9f1a9a190 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:46.484145 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d9709326-9e0a-44c9-8fbf-05a9f1a9a190 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:46.492980 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d9709326-9e0a-44c9-8fbf-05a9f1a9a190 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1511 microversion: 2.1 time: 0.272623 Sep 27 16:39:46.493906 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 222/420] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:46 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1511 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:46.593254 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-607540c6-27ff-499d-896a-78edabf4f47c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:46.593971 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-607540c6-27ff-499d-896a-78edabf4f47c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:46.600632 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-607540c6-27ff-499d-896a-78edabf4f47c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:46.601405 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-607540c6-27ff-499d-896a-78edabf4f47c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:46.601855 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-607540c6-27ff-499d-896a-78edabf4f47c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:46.602556 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-607540c6-27ff-499d-896a-78edabf4f47c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:46.603028 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-607540c6-27ff-499d-896a-78edabf4f47c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:46.603472 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-607540c6-27ff-499d-896a-78edabf4f47c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:46.929606 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-607540c6-27ff-499d-896a-78edabf4f47c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:46.945336 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-607540c6-27ff-499d-896a-78edabf4f47c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:46.946768 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-607540c6-27ff-499d-896a-78edabf4f47c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:46.948074 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-607540c6-27ff-499d-896a-78edabf4f47c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.359635 Sep 27 16:39:46.949614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 199/421] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:46 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:47.521425 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-addca984-dc9d-491c-a4ee-5a07f413dbfe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:47.522053 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-addca984-dc9d-491c-a4ee-5a07f413dbfe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:47.537727 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-addca984-dc9d-491c-a4ee-5a07f413dbfe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:47.539010 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-addca984-dc9d-491c-a4ee-5a07f413dbfe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:47.541083 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-addca984-dc9d-491c-a4ee-5a07f413dbfe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:47.545075 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-addca984-dc9d-491c-a4ee-5a07f413dbfe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:47.546595 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-addca984-dc9d-491c-a4ee-5a07f413dbfe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:47.547205 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-addca984-dc9d-491c-a4ee-5a07f413dbfe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:47.680815 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d818757b-bc13-4b13-a367-e127bc245bca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1821366212", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-878616145", "security_groups": [{"name": "tempest-secgroup-smoke-849232985"}], "block_device_mapping_v2": [{"uuid": "0761b009-de31-41b7-aca6-0b6c42514ac7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fa6ed79c-29cf-4084-8c9a-3f99a2a02140"}]}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:47.922112 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-addca984-dc9d-491c-a4ee-5a07f413dbfe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:47.930597 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-addca984-dc9d-491c-a4ee-5a07f413dbfe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1511 microversion: 2.1 time: 0.415510 Sep 27 16:39:47.931445 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 223/422] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:47 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1511 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:47.979661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-d818757b-bc13-4b13-a367-e127bc245bca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] validate_networks() for [('fa6ed79c-29cf-4084-8c9a-3f99a2a02140', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 16:39:47.983364 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3a1d4643-bda7-4faf-8fc1-21c03fcc3ef7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:47.984640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3a1d4643-bda7-4faf-8fc1-21c03fcc3ef7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:47.998482 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a1d4643-bda7-4faf-8fc1-21c03fcc3ef7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:47.999774 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a1d4643-bda7-4faf-8fc1-21c03fcc3ef7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:48.000554 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a1d4643-bda7-4faf-8fc1-21c03fcc3ef7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:48.001942 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a1d4643-bda7-4faf-8fc1-21c03fcc3ef7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:48.002679 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a1d4643-bda7-4faf-8fc1-21c03fcc3ef7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:48.003541 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a1d4643-bda7-4faf-8fc1-21c03fcc3ef7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:48.683376 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3a1d4643-bda7-4faf-8fc1-21c03fcc3ef7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:48.693269 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3a1d4643-bda7-4faf-8fc1-21c03fcc3ef7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:48.694764 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3a1d4643-bda7-4faf-8fc1-21c03fcc3ef7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:48.696191 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3a1d4643-bda7-4faf-8fc1-21c03fcc3ef7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.723782 Sep 27 16:39:48.696876 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 224/423] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:47 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:48.953733 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-79a2a170-7d9e-4351-8fe8-943487b7b5e5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:48.954996 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-79a2a170-7d9e-4351-8fe8-943487b7b5e5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:48.963421 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79a2a170-7d9e-4351-8fe8-943487b7b5e5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:48.965989 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79a2a170-7d9e-4351-8fe8-943487b7b5e5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:48.967272 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79a2a170-7d9e-4351-8fe8-943487b7b5e5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:48.969083 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79a2a170-7d9e-4351-8fe8-943487b7b5e5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:48.969848 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79a2a170-7d9e-4351-8fe8-943487b7b5e5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:48.970538 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79a2a170-7d9e-4351-8fe8-943487b7b5e5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:49.157247 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-d818757b-bc13-4b13-a367-e127bc245bca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 16:39:49.157835 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-d818757b-bc13-4b13-a367-e127bc245bca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 16:39:49.158560 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-d818757b-bc13-4b13-a367-e127bc245bca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 16:39:49.159499 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-d818757b-bc13-4b13-a367-e127bc245bca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 16:39:49.168183 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-d818757b-bc13-4b13-a367-e127bc245bca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 16:39:49.176564 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d818757b-bc13-4b13-a367-e127bc245bca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:49.177470 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d818757b-bc13-4b13-a367-e127bc245bca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:49.178367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d818757b-bc13-4b13-a367-e127bc245bca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:49.179478 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d818757b-bc13-4b13-a367-e127bc245bca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:49.180162 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d818757b-bc13-4b13-a367-e127bc245bca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:49.181118 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d818757b-bc13-4b13-a367-e127bc245bca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:49.198218 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-79a2a170-7d9e-4351-8fe8-943487b7b5e5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:49.204433 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-d818757b-bc13-4b13-a367-e127bc245bca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Getting quotas for project 1e0f894b53284e788cdb4864acd917be. Resources: {'instances', 'ram', 'cores'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:39:49.212509 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-d818757b-bc13-4b13-a367-e127bc245bca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Getting quotas for user 421aaa238a3c495096dfc55aba76267c and project 1e0f894b53284e788cdb4864acd917be. Resources: {'instances', 'ram', 'cores'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:39:49.213561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-79a2a170-7d9e-4351-8fe8-943487b7b5e5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1517 microversion: 2.1 time: 0.263470 Sep 27 16:39:49.214881 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 225/424] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:48 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1517 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:39:49.279336 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-396849d8-2fef-48ac-a0c6-1f9362c7872f req-eeac503b-6b3a-44db-a9c0-572868ca95ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54bed735-4766-4b93-9db9-4c3731eec6c7", "tag": "95614818-7cd1-4590-9696-e7a8c3f6a751"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:49.298390 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-396849d8-2fef-48ac-a0c6-1f9362c7872f req-eeac503b-6b3a-44db-a9c0-572868ca95ea service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:49.299173 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-396849d8-2fef-48ac-a0c6-1f9362c7872f req-eeac503b-6b3a-44db-a9c0-572868ca95ea service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:49.299969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-396849d8-2fef-48ac-a0c6-1f9362c7872f req-eeac503b-6b3a-44db-a9c0-572868ca95ea service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:49.318406 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-396849d8-2fef-48ac-a0c6-1f9362c7872f req-eeac503b-6b3a-44db-a9c0-572868ca95ea service nova] Creating event network-changed:95614818-7cd1-4590-9696-e7a8c3f6a751 for instance 54bed735-4766-4b93-9db9-4c3731eec6c7 on hv-cinder-85506 Sep 27 16:39:49.321937 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-396849d8-2fef-48ac-a0c6-1f9362c7872f req-eeac503b-6b3a-44db-a9c0-572868ca95ea service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047743 Sep 27 16:39:49.323107 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 226/425] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:39:49.338486 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d818757b-bc13-4b13-a367-e127bc245bca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 16:39:49.342185 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d818757b-bc13-4b13-a367-e127bc245bca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0761b009-de31-41b7-aca6-0b6c42514ac7',volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 16:39:49.726270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8d7457ea-f613-44d0-9937-ada74233a4a3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:49.726270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8d7457ea-f613-44d0-9937-ada74233a4a3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:49.740169 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d7457ea-f613-44d0-9937-ada74233a4a3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:49.740668 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d7457ea-f613-44d0-9937-ada74233a4a3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:49.741110 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d7457ea-f613-44d0-9937-ada74233a4a3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:49.741812 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d7457ea-f613-44d0-9937-ada74233a4a3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:49.746214 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d7457ea-f613-44d0-9937-ada74233a4a3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:49.751803 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d7457ea-f613-44d0-9937-ada74233a4a3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:49.824977 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d818757b-bc13-4b13-a367-e127bc245bca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.148154 Sep 27 16:39:49.825869 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 200/426] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Sep 27 16:39:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 2150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 16:39:49.838281 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-963774da-4cad-48b1-b28c-39f384ad18fc tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:49.847183 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-963774da-4cad-48b1-b28c-39f384ad18fc tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:49.978448 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-963774da-4cad-48b1-b28c-39f384ad18fc tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:49.988789 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-963774da-4cad-48b1-b28c-39f384ad18fc tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1094 microversion: 2.1 time: 0.154391 Sep 27 16:39:49.989360 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 201/427] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:49 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1094 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:50.066048 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8d7457ea-f613-44d0-9937-ada74233a4a3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:50.079157 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8d7457ea-f613-44d0-9937-ada74233a4a3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:50.081379 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8d7457ea-f613-44d0-9937-ada74233a4a3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:50.082907 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8d7457ea-f613-44d0-9937-ada74233a4a3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.362244 Sep 27 16:39:50.084025 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 227/428] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:49 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:51.013977 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-eeb47e00-e28a-45dc-a90e-9ca12dce38cc tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:51.014650 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-eeb47e00-e28a-45dc-a90e-9ca12dce38cc tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:51.111274 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9654c678-263f-4dc8-a673-4dbfa646767a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:51.112485 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9654c678-263f-4dc8-a673-4dbfa646767a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:51.117243 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-eeb47e00-e28a-45dc-a90e-9ca12dce38cc tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:51.125837 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9654c678-263f-4dc8-a673-4dbfa646767a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:51.126431 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9654c678-263f-4dc8-a673-4dbfa646767a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:51.126851 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9654c678-263f-4dc8-a673-4dbfa646767a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:51.127580 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9654c678-263f-4dc8-a673-4dbfa646767a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:51.128052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9654c678-263f-4dc8-a673-4dbfa646767a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:51.128482 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9654c678-263f-4dc8-a673-4dbfa646767a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:51.131485 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-eeb47e00-e28a-45dc-a90e-9ca12dce38cc tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1094 microversion: 2.1 time: 0.121967 Sep 27 16:39:51.132632 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 202/429] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:51 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1094 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:51.179425 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3626d296-e11c-4f32-8c0a-78b70c3340f0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Action: 'create', calling method: .version_select at 0x7fa405a92790>, body: {"keypair": {"name": "tempest-keypair-205589464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJhGqv8Gq6eIZ44bX382ehJ31hGlMsCNcbsSY6RJvW/mwwg5CjOsh9JpEbprmHG3dzTHrdaWf2NEjOhkCRTtMYn5+YNvWv+mB35z2JqnmuxgYUF8QruOEnjbjI7YWGhng=="}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:51.239016 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-3626d296-e11c-4f32-8c0a-78b70c3340f0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Getting quotas for project 9288b4e62bc945479636aec307a98746. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:39:51.247822 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-3626d296-e11c-4f32-8c0a-78b70c3340f0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Getting quotas for user 2f9e55a3ff7c424dbd7a58f0eb92b8ce and project 9288b4e62bc945479636aec307a98746. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:39:51.376067 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3626d296-e11c-4f32-8c0a-78b70c3340f0 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.201406 Sep 27 16:39:51.377191 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 203/430] 10.222.0.64 () {60 vars in 1159 bytes} [Tue Sep 27 16:39:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:39:51.442163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9654c678-263f-4dc8-a673-4dbfa646767a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:51.453931 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9654c678-263f-4dc8-a673-4dbfa646767a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:51.455635 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9654c678-263f-4dc8-a673-4dbfa646767a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:51.457049 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9654c678-263f-4dc8-a673-4dbfa646767a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.349996 Sep 27 16:39:51.457937 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 228/431] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:51 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:52.155994 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5bcc8ff0-de25-4a24-8676-bdedbd56e078 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:52.157407 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5bcc8ff0-de25-4a24-8676-bdedbd56e078 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:52.167040 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bcc8ff0-de25-4a24-8676-bdedbd56e078 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:52.167644 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bcc8ff0-de25-4a24-8676-bdedbd56e078 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:52.168474 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bcc8ff0-de25-4a24-8676-bdedbd56e078 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:52.169771 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bcc8ff0-de25-4a24-8676-bdedbd56e078 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:52.185471 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bcc8ff0-de25-4a24-8676-bdedbd56e078 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:52.185471 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bcc8ff0-de25-4a24-8676-bdedbd56e078 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:52.253097 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5bcc8ff0-de25-4a24-8676-bdedbd56e078 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:52.262209 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5bcc8ff0-de25-4a24-8676-bdedbd56e078 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1192 microversion: 2.1 time: 0.112190 Sep 27 16:39:52.262854 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 204/432] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:52 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1192 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:52.497726 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7d8c968c-c045-4472-bcea-be7393110532 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:52.497726 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7d8c968c-c045-4472-bcea-be7393110532 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:52.499002 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7d8c968c-c045-4472-bcea-be7393110532 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:52.499528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7d8c968c-c045-4472-bcea-be7393110532 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:52.500096 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7d8c968c-c045-4472-bcea-be7393110532 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:52.500804 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7d8c968c-c045-4472-bcea-be7393110532 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:52.501267 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7d8c968c-c045-4472-bcea-be7393110532 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:52.501692 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7d8c968c-c045-4472-bcea-be7393110532 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:52.712297 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7d8c968c-c045-4472-bcea-be7393110532 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:52.724411 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7d8c968c-c045-4472-bcea-be7393110532 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:52.726070 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7d8c968c-c045-4472-bcea-be7393110532 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:52.727257 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7d8c968c-c045-4472-bcea-be7393110532 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.243890 Sep 27 16:39:52.739035 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-aa71a4f7-6328-4ce9-8680-8cd270f19699 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-432054214"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:52.739035 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-aa71a4f7-6328-4ce9-8680-8cd270f19699 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:52.740748 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 229/433] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:52 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:52.751104 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa71a4f7-6328-4ce9-8680-8cd270f19699 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:52.751104 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa71a4f7-6328-4ce9-8680-8cd270f19699 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:52.751104 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa71a4f7-6328-4ce9-8680-8cd270f19699 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:52.753626 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa71a4f7-6328-4ce9-8680-8cd270f19699 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:52.754588 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa71a4f7-6328-4ce9-8680-8cd270f19699 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:52.756015 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa71a4f7-6328-4ce9-8680-8cd270f19699 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:52.925696 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.network.security_group_api [None req-aa71a4f7-6328-4ce9-8680-8cd270f19699 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Adding security group 02540f7c-f22e-42a2-9262-958f6ddd2582 to port 95614818-7cd1-4590-9696-e7a8c3f6a751 Sep 27 16:39:53.265489 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-e8a256c7-d5cb-4e88-a545-8285312b2fca req-78b2d198-e169-4439-a573-bb4f54163ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84acf37-9445-48cd-a921-12a7a3c301d9", "name": "network-vif-plugged", "status": "completed", "tag": "184e6faa-be62-4210-acc1-64aceea7f1f0"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:53.303040 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-e8a256c7-d5cb-4e88-a545-8285312b2fca req-78b2d198-e169-4439-a573-bb4f54163ef3 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:53.309912 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-e8a256c7-d5cb-4e88-a545-8285312b2fca req-78b2d198-e169-4439-a573-bb4f54163ef3 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:53.310720 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-e8a256c7-d5cb-4e88-a545-8285312b2fca req-78b2d198-e169-4439-a573-bb4f54163ef3 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:53.337645 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-e8a256c7-d5cb-4e88-a545-8285312b2fca req-78b2d198-e169-4439-a573-bb4f54163ef3 service nova] Creating event network-vif-plugged:184e6faa-be62-4210-acc1-64aceea7f1f0 for instance f84acf37-9445-48cd-a921-12a7a3c301d9 on hv-cinder-85506 Sep 27 16:39:53.346573 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-e8a256c7-d5cb-4e88-a545-8285312b2fca req-78b2d198-e169-4439-a573-bb4f54163ef3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087001 Sep 27 16:39:53.499164 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 230/434] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:39:53.499164 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7c2edd3a-a1c9-4531-bc0b-1173cacbf993 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:53.499164 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7c2edd3a-a1c9-4531-bc0b-1173cacbf993 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:53.499164 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7c2edd3a-a1c9-4531-bc0b-1173cacbf993 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:53.499164 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7c2edd3a-a1c9-4531-bc0b-1173cacbf993 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:53.505566 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7c2edd3a-a1c9-4531-bc0b-1173cacbf993 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:53.505566 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7c2edd3a-a1c9-4531-bc0b-1173cacbf993 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:53.505566 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7c2edd3a-a1c9-4531-bc0b-1173cacbf993 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:53.505566 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7c2edd3a-a1c9-4531-bc0b-1173cacbf993 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:53.513229 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7c2edd3a-a1c9-4531-bc0b-1173cacbf993 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:53.513229 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7c2edd3a-a1c9-4531-bc0b-1173cacbf993 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1192 microversion: 2.1 time: 0.145822 Sep 27 16:39:53.513229 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 231/435] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:53 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1192 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:53.553380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-aa71a4f7-6328-4ce9-8680-8cd270f19699 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "POST /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7/action" status: 202 len: 0 microversion: 2.1 time: 0.822900 Sep 27 16:39:53.554934 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 205/436] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Sep 27 16:39:52 2022] POST /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7/action => generated 0 bytes in 825 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:39:53.563968 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-20abb0c8-e897-4367-af80-3ce0f5e4eb88 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:53.569342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-bffae872-386f-458a-be06-43db40088905 req-8acd0926-2962-4778-be94-92f7768ac640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54bed735-4766-4b93-9db9-4c3731eec6c7", "tag": "95614818-7cd1-4590-9696-e7a8c3f6a751"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:53.570465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-20abb0c8-e897-4367-af80-3ce0f5e4eb88 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:53.576910 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=78 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:53.599862 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20abb0c8-e897-4367-af80-3ce0f5e4eb88 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:53.607397 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-bffae872-386f-458a-be06-43db40088905 req-8acd0926-2962-4778-be94-92f7768ac640 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:53.608302 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20abb0c8-e897-4367-af80-3ce0f5e4eb88 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:53.608920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20abb0c8-e897-4367-af80-3ce0f5e4eb88 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:53.619794 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20abb0c8-e897-4367-af80-3ce0f5e4eb88 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:53.621200 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-bffae872-386f-458a-be06-43db40088905 req-8acd0926-2962-4778-be94-92f7768ac640 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:53.621641 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-bffae872-386f-458a-be06-43db40088905 req-8acd0926-2962-4778-be94-92f7768ac640 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:53.624863 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20abb0c8-e897-4367-af80-3ce0f5e4eb88 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:53.625501 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20abb0c8-e897-4367-af80-3ce0f5e4eb88 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:53.656083 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-bffae872-386f-458a-be06-43db40088905 req-8acd0926-2962-4778-be94-92f7768ac640 service nova] Creating event network-changed:95614818-7cd1-4590-9696-e7a8c3f6a751 for instance 54bed735-4766-4b93-9db9-4c3731eec6c7 on hv-cinder-85506 Sep 27 16:39:53.662658 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-bffae872-386f-458a-be06-43db40088905 req-8acd0926-2962-4778-be94-92f7768ac640 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096431 Sep 27 16:39:53.664384 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 206/437] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:39:53.769525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b19df8d7-c0b6-4ede-975e-cefc89dfc96f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:53.770853 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b19df8d7-c0b6-4ede-975e-cefc89dfc96f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:53.777780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b19df8d7-c0b6-4ede-975e-cefc89dfc96f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:53.780070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b19df8d7-c0b6-4ede-975e-cefc89dfc96f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:53.780070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b19df8d7-c0b6-4ede-975e-cefc89dfc96f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:53.780070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b19df8d7-c0b6-4ede-975e-cefc89dfc96f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:53.780714 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b19df8d7-c0b6-4ede-975e-cefc89dfc96f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:53.781313 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b19df8d7-c0b6-4ede-975e-cefc89dfc96f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:53.907895 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-20abb0c8-e897-4367-af80-3ce0f5e4eb88 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:53.923320 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-20abb0c8-e897-4367-af80-3ce0f5e4eb88 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1760 microversion: 2.1 time: 0.363288 Sep 27 16:39:53.926714 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 232/438] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:53 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1760 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:54.032221 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b19df8d7-c0b6-4ede-975e-cefc89dfc96f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:54.047387 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b19df8d7-c0b6-4ede-975e-cefc89dfc96f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:54.049389 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b19df8d7-c0b6-4ede-975e-cefc89dfc96f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:54.053269 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b19df8d7-c0b6-4ede-975e-cefc89dfc96f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.291001 Sep 27 16:39:54.057218 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 207/439] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:53 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:39:54.519097 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8ed30193-b86b-49b0-9531-dd56794a29ec tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:54.519711 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8ed30193-b86b-49b0-9531-dd56794a29ec tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:54.525882 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ed30193-b86b-49b0-9531-dd56794a29ec tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:54.526466 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ed30193-b86b-49b0-9531-dd56794a29ec tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:54.527156 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ed30193-b86b-49b0-9531-dd56794a29ec tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:54.527694 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ed30193-b86b-49b0-9531-dd56794a29ec tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:54.528159 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ed30193-b86b-49b0-9531-dd56794a29ec tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:54.528586 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ed30193-b86b-49b0-9531-dd56794a29ec tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:54.669377 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8ed30193-b86b-49b0-9531-dd56794a29ec tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:54.678495 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8ed30193-b86b-49b0-9531-dd56794a29ec tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1210 microversion: 2.1 time: 0.163348 Sep 27 16:39:54.679152 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 233/440] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:54 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1210 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:54.865804 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d1699600-05b5-4237-994a-e209851be297 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1610570167", "imageRef": "6908a343-46fa-4801-bfb5-7ad92ac26956", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c69d5dae-8230-4d1b-853f-7ade2d011d4c"}], "security_groups": [{"name": "tempest-securitygroup--142050740"}], "key_name": "tempest-keypair-205589464", "user_data": "}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:54.971672 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-d1699600-05b5-4237-994a-e209851be297 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] validate_networks() for [('c69d5dae-8230-4d1b-853f-7ade2d011d4c', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 16:39:55.083324 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f8b58856-2b68-4193-88ab-bd32b552edeb tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:55.083934 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f8b58856-2b68-4193-88ab-bd32b552edeb tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:55.090367 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f8b58856-2b68-4193-88ab-bd32b552edeb tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:55.090878 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f8b58856-2b68-4193-88ab-bd32b552edeb tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:55.091314 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f8b58856-2b68-4193-88ab-bd32b552edeb tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:55.092009 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f8b58856-2b68-4193-88ab-bd32b552edeb tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:55.092465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f8b58856-2b68-4193-88ab-bd32b552edeb tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:55.092952 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f8b58856-2b68-4193-88ab-bd32b552edeb tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:55.097274 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:55.381607 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f8b58856-2b68-4193-88ab-bd32b552edeb tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:55.391182 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f8b58856-2b68-4193-88ab-bd32b552edeb tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:55.392984 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f8b58856-2b68-4193-88ab-bd32b552edeb tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:55.394450 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f8b58856-2b68-4193-88ab-bd32b552edeb tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.315007 Sep 27 16:39:55.407556 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 234/441] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:55 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:39:55.538527 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-d1699600-05b5-4237-994a-e209851be297 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 16:39:55.538527 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-d1699600-05b5-4237-994a-e209851be297 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 16:39:55.538527 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-d1699600-05b5-4237-994a-e209851be297 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 16:39:55.538527 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-d1699600-05b5-4237-994a-e209851be297 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 16:39:55.538527 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-d1699600-05b5-4237-994a-e209851be297 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 16:39:55.544959 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d1699600-05b5-4237-994a-e209851be297 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:55.545448 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d1699600-05b5-4237-994a-e209851be297 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:55.545889 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d1699600-05b5-4237-994a-e209851be297 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:55.546628 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d1699600-05b5-4237-994a-e209851be297 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:55.547129 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d1699600-05b5-4237-994a-e209851be297 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:55.547557 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d1699600-05b5-4237-994a-e209851be297 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:55.567894 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-d1699600-05b5-4237-994a-e209851be297 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Getting quotas for project 9288b4e62bc945479636aec307a98746. Resources: {'instances', 'ram', 'cores'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:39:55.572382 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-d1699600-05b5-4237-994a-e209851be297 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Getting quotas for user 2f9e55a3ff7c424dbd7a58f0eb92b8ce and project 9288b4e62bc945479636aec307a98746. Resources: {'instances', 'ram', 'cores'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:39:55.586965 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d1699600-05b5-4237-994a-e209851be297 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 16:39:55.590179 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d1699600-05b5-4237-994a-e209851be297 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6908a343-46fa-4801-bfb5-7ad92ac26956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 16:39:55.701250 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d1699600-05b5-4237-994a-e209851be297 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.839633 Sep 27 16:39:55.701901 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-40a038db-5eaa-46d1-b49a-0b5bed8071bd tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:55.702758 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-40a038db-5eaa-46d1-b49a-0b5bed8071bd tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:55.709436 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 208/442] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Sep 27 16:39:54 2022] POST /compute/v2.1/servers => generated 408 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 16:39:55.715197 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3c3c3fdf-b1f0-41e6-8fc6-528651e27dc5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:55.722556 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3c3c3fdf-b1f0-41e6-8fc6-528651e27dc5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:55.723489 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-40a038db-5eaa-46d1-b49a-0b5bed8071bd tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:55.723489 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-40a038db-5eaa-46d1-b49a-0b5bed8071bd tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:55.723489 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-40a038db-5eaa-46d1-b49a-0b5bed8071bd tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:55.723489 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-40a038db-5eaa-46d1-b49a-0b5bed8071bd tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:55.723879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-40a038db-5eaa-46d1-b49a-0b5bed8071bd tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:55.723879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-40a038db-5eaa-46d1-b49a-0b5bed8071bd tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:55.866488 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-40a038db-5eaa-46d1-b49a-0b5bed8071bd tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:55.868677 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3c3c3fdf-b1f0-41e6-8fc6-528651e27dc5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:55.874895 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-40a038db-5eaa-46d1-b49a-0b5bed8071bd tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1210 microversion: 2.1 time: 0.177222 Sep 27 16:39:55.875522 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 235/443] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:55 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1210 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:55.883074 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3c3c3fdf-b1f0-41e6-8fc6-528651e27dc5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1245 microversion: 2.1 time: 0.172382 Sep 27 16:39:55.883590 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 209/444] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:55 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1245 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:56.421387 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-28511877-259e-4981-a9e4-07bf174e5b42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:56.422013 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-28511877-259e-4981-a9e4-07bf174e5b42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:56.433523 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-28511877-259e-4981-a9e4-07bf174e5b42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:56.434220 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-28511877-259e-4981-a9e4-07bf174e5b42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:56.434731 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-28511877-259e-4981-a9e4-07bf174e5b42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:56.435509 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-28511877-259e-4981-a9e4-07bf174e5b42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:56.435973 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-28511877-259e-4981-a9e4-07bf174e5b42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:56.436403 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-28511877-259e-4981-a9e4-07bf174e5b42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:56.610095 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-28511877-259e-4981-a9e4-07bf174e5b42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:56.620997 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-28511877-259e-4981-a9e4-07bf174e5b42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:56.622565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-28511877-259e-4981-a9e4-07bf174e5b42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:56.623847 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-28511877-259e-4981-a9e4-07bf174e5b42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.207875 Sep 27 16:39:56.627039 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 236/445] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:56 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:56.900087 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6f88e71e-eb36-40a6-b2a0-ed9236847e10 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:56.900690 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6f88e71e-eb36-40a6-b2a0-ed9236847e10 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:56.905709 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7a3ec456-4325-41d6-8577-ec878383d562 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:56.906436 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7a3ec456-4325-41d6-8577-ec878383d562 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:56.907932 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f88e71e-eb36-40a6-b2a0-ed9236847e10 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:56.908413 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f88e71e-eb36-40a6-b2a0-ed9236847e10 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:56.909132 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f88e71e-eb36-40a6-b2a0-ed9236847e10 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:56.909817 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f88e71e-eb36-40a6-b2a0-ed9236847e10 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:56.910292 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f88e71e-eb36-40a6-b2a0-ed9236847e10 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:56.910762 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f88e71e-eb36-40a6-b2a0-ed9236847e10 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:56.912669 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7a3ec456-4325-41d6-8577-ec878383d562 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:56.913154 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7a3ec456-4325-41d6-8577-ec878383d562 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:56.913592 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7a3ec456-4325-41d6-8577-ec878383d562 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:56.914318 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7a3ec456-4325-41d6-8577-ec878383d562 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:56.914993 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:56.920192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7a3ec456-4325-41d6-8577-ec878383d562 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:56.920829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7a3ec456-4325-41d6-8577-ec878383d562 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:57.023217 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7a3ec456-4325-41d6-8577-ec878383d562 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:57.032671 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7a3ec456-4325-41d6-8577-ec878383d562 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1249 microversion: 2.1 time: 0.131207 Sep 27 16:39:57.033621 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 237/446] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:56 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1249 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:39:57.088444 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6f88e71e-eb36-40a6-b2a0-ed9236847e10 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:57.097646 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6f88e71e-eb36-40a6-b2a0-ed9236847e10 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1277 microversion: 2.1 time: 0.201503 Sep 27 16:39:57.098424 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 210/447] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:56 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1277 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:57.308109 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-5da65014-9c9a-425a-912c-3aa85b1eb667 req-a0bf633a-b942-4d85-925e-2e3c6782fa00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d959d05-2c44-4e4c-a8c0-9dd0b985b564", "tag": "52f691b3-ea75-4afe-9e42-e90c76a84965"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:57.317586 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-5da65014-9c9a-425a-912c-3aa85b1eb667 req-a0bf633a-b942-4d85-925e-2e3c6782fa00 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:57.318066 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-5da65014-9c9a-425a-912c-3aa85b1eb667 req-a0bf633a-b942-4d85-925e-2e3c6782fa00 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:57.318493 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-5da65014-9c9a-425a-912c-3aa85b1eb667 req-a0bf633a-b942-4d85-925e-2e3c6782fa00 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:57.329487 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-5da65014-9c9a-425a-912c-3aa85b1eb667 req-a0bf633a-b942-4d85-925e-2e3c6782fa00 service nova] Creating event network-changed:52f691b3-ea75-4afe-9e42-e90c76a84965 for instance 3d959d05-2c44-4e4c-a8c0-9dd0b985b564 on hv-cinder-85506 Sep 27 16:39:57.334637 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-5da65014-9c9a-425a-912c-3aa85b1eb667 req-a0bf633a-b942-4d85-925e-2e3c6782fa00 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030364 Sep 27 16:39:57.335425 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 238/448] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:39:57.649691 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fa28be0d-f8b2-49c9-9395-ad1a1fd3b1a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:57.650287 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fa28be0d-f8b2-49c9-9395-ad1a1fd3b1a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:57.656958 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fa28be0d-f8b2-49c9-9395-ad1a1fd3b1a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:57.657437 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fa28be0d-f8b2-49c9-9395-ad1a1fd3b1a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:57.657864 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fa28be0d-f8b2-49c9-9395-ad1a1fd3b1a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:57.658545 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fa28be0d-f8b2-49c9-9395-ad1a1fd3b1a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:57.659278 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fa28be0d-f8b2-49c9-9395-ad1a1fd3b1a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:57.659696 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fa28be0d-f8b2-49c9-9395-ad1a1fd3b1a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:57.790558 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fa28be0d-f8b2-49c9-9395-ad1a1fd3b1a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:57.799311 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fa28be0d-f8b2-49c9-9395-ad1a1fd3b1a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:57.800744 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fa28be0d-f8b2-49c9-9395-ad1a1fd3b1a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:57.801923 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fa28be0d-f8b2-49c9-9395-ad1a1fd3b1a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.156178 Sep 27 16:39:57.802484 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 211/449] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:57 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:39:58.055854 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-56a30ec3-16ff-40cf-9abc-b7d1a524bbd8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:58.056509 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-56a30ec3-16ff-40cf-9abc-b7d1a524bbd8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:58.063592 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-56a30ec3-16ff-40cf-9abc-b7d1a524bbd8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:58.064083 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-56a30ec3-16ff-40cf-9abc-b7d1a524bbd8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:58.064528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-56a30ec3-16ff-40cf-9abc-b7d1a524bbd8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:58.065225 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-56a30ec3-16ff-40cf-9abc-b7d1a524bbd8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:58.065687 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-56a30ec3-16ff-40cf-9abc-b7d1a524bbd8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:58.066118 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-56a30ec3-16ff-40cf-9abc-b7d1a524bbd8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:58.122288 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b7d345b5-a671-4003-9fc3-d4636f2526e6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:58.122929 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b7d345b5-a671-4003-9fc3-d4636f2526e6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:58.128917 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-56a30ec3-16ff-40cf-9abc-b7d1a524bbd8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:58.129455 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7d345b5-a671-4003-9fc3-d4636f2526e6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:58.129943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7d345b5-a671-4003-9fc3-d4636f2526e6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:58.130374 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7d345b5-a671-4003-9fc3-d4636f2526e6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:58.131098 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7d345b5-a671-4003-9fc3-d4636f2526e6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:58.131552 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7d345b5-a671-4003-9fc3-d4636f2526e6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:58.131976 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7d345b5-a671-4003-9fc3-d4636f2526e6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:58.137050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-56a30ec3-16ff-40cf-9abc-b7d1a524bbd8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1249 microversion: 2.1 time: 0.085524 Sep 27 16:39:58.137647 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 239/450] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:58 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:58.261958 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b7d345b5-a671-4003-9fc3-d4636f2526e6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:58.270074 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b7d345b5-a671-4003-9fc3-d4636f2526e6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1277 microversion: 2.1 time: 0.152763 Sep 27 16:39:58.270585 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 212/451] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:58 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:39:58.315045 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bd4d1701-534d-495e-8a7c-6326075a5037 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:58.315482 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bd4d1701-534d-495e-8a7c-6326075a5037 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:58.321561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd4d1701-534d-495e-8a7c-6326075a5037 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:58.322047 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd4d1701-534d-495e-8a7c-6326075a5037 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:58.322484 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd4d1701-534d-495e-8a7c-6326075a5037 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:58.323212 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd4d1701-534d-495e-8a7c-6326075a5037 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:58.324373 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd4d1701-534d-495e-8a7c-6326075a5037 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:58.324804 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd4d1701-534d-495e-8a7c-6326075a5037 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:58.347560 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bd4d1701-534d-495e-8a7c-6326075a5037 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca/ips" status: 200 len: 148 microversion: 2.1 time: 0.036348 Sep 27 16:39:58.348132 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 240/452] 10.222.0.64 () {58 vars in 1248 bytes} [Tue Sep 27 16:39:58 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:39:58.359766 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6288014e-0d9f-47e6-aeff-5a1051511335 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6711ce7-ec46-495c-a651-72c6a6b1964e"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:39:58.362128 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6288014e-0d9f-47e6-aeff-5a1051511335 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:58.367961 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6288014e-0d9f-47e6-aeff-5a1051511335 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:58.368437 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6288014e-0d9f-47e6-aeff-5a1051511335 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:58.368864 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6288014e-0d9f-47e6-aeff-5a1051511335 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:58.369541 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6288014e-0d9f-47e6-aeff-5a1051511335 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:58.369988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6288014e-0d9f-47e6-aeff-5a1051511335 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:58.370981 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6288014e-0d9f-47e6-aeff-5a1051511335 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:58.448429 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-6288014e-0d9f-47e6-aeff-5a1051511335 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] HTTP exception thrown: Invalid volume: volume a6711ce7-ec46-495c-a651-72c6a6b1964e is already attached to instances: 8010c1e5-fe22-4255-a8df-0f63551bb226 Sep 27 16:39:58.450177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6288014e-0d9f-47e6-aeff-5a1051511335 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Request method failure captured: Sep 27 16:39:58.450177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: POST /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca/os-volume_attachments HTTP/1.1 Sep 27 16:39:58.450177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:39:58.450177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:39:58.450177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:39:58.450177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 74 Sep 27 16:39:58.450177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:39:58.450177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:39:58.450177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:39:58.450177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:39:58.450177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMyaXt7kpD0PfNVvLYuBuVZ7HRidwt4V7Ad9Ym3_Vbex0YLxAbLBHGS-HGBld9NGzCqyRTvioGgsu3eg4VIjDtZIgTd01qZ6DSQMCZ0BknQO4xdhtqMgcyIwM-7CdV1bNe00wPntnIGZvSkxLDfg4QN7aDekfETC-lFwzlHlACFvCF14 Sep 27 16:39:58.450177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:39:58.450177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:39:58.450177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:39:58.450177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:39:58.450177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:39:58.450177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:39:58.450177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:39:58.450177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:39:58.450177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:39:58.450177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:39:58.451748 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_73fad530905b485cb7141793f6130a9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/73fad530905b485cb7141793f6130a9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:39:58.451748 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:39:58.451748 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:39:58.451748 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:39:58.451748 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:39:58.451748 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:39:58.451748 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:39:58.451748 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: e8d3af2b82b641aea11ebf79677a3af1 Sep 27 16:39:58.451748 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:39:58.451748 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Sep 27 16:39:58.451748 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {"volumeAttachment": {"volumeId": "a6711ce7-ec46-495c-a651-72c6a6b1964e"}} Sep 27 16:39:58.451748 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: > Sep 27 16:39:58.452686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Invalid volume: volume a6711ce7-ec46-495c-a651-72c6a6b1964e is already attached to instances: 8010c1e5-fe22-4255-a8df-0f63551bb226 Sep 27 16:39:58.452686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'server_id': 'c2bb023b-8f1e-4e58-969b-e6c56395acca', 'body': {'volumeAttachment': {'volumeId': 'a6711ce7-ec46-495c-a651-72c6a6b1964e'}}} Sep 27 16:39:58.452686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:39:58.452686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:39:58.452686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 27 16:39:58.452686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 27 16:39:58.452686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 16:39:58.452686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 16:39:58.452686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 27 16:39:58.452686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 27 16:39:58.452686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 27 16:39:58.452686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 27 16:39:58.452686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 27 16:39:58.452686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 27 16:39:58.452686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a6711ce7-ec46-495c-a651-72c6a6b1964e is already attached to instances: 8010c1e5-fe22-4255-a8df-0f63551bb226 Sep 27 16:39:58.452686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:39:58.452686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:39:58.452686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:39:58.452686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:39:58.454054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:39:58.454054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:39:58.454054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:39:58.454054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:39:58.454054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:39:58.454054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:39:58.454054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 16:39:58.454054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 16:39:58.454054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 16:39:58.454054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 16:39:58.454054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 16:39:58.454054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 16:39:58.454054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 27 16:39:58.454054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 27 16:39:58.454054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a6711ce7-ec46-495c-a651-72c6a6b1964e is already attached to instances: 8010c1e5-fe22-4255-a8df-0f63551bb226 Sep 27 16:39:58.454054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:39:58.454054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:39:58.454054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:39:58.454054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:39:58.454054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:39:58.455495 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:39:58.455495 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:39:58.455495 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:39:58.455495 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a6711ce7-ec46-495c-a651-72c6a6b1964e is already attached to instances: 8010c1e5-fe22-4255-a8df-0f63551bb226 Sep 27 16:39:58.455495 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:39:58.455495 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6288014e-0d9f-47e6-aeff-5a1051511335 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Returning 400 to user: Invalid volume: volume a6711ce7-ec46-495c-a651-72c6a6b1964e is already attached to instances: 8010c1e5-fe22-4255-a8df-0f63551bb226 {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:39:58.455495 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6288014e-0d9f-47e6-aeff-5a1051511335 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "POST /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095778 Sep 27 16:39:58.455495 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 213/453] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Sep 27 16:39:58 2022] POST /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 16:39:58.460475 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-03fbcd76-7e1a-49a2-bcd0-f3d611ef2191 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:58.460966 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-03fbcd76-7e1a-49a2-bcd0-f3d611ef2191 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:58.466940 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-03fbcd76-7e1a-49a2-bcd0-f3d611ef2191 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:58.467419 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-03fbcd76-7e1a-49a2-bcd0-f3d611ef2191 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:58.467851 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-03fbcd76-7e1a-49a2-bcd0-f3d611ef2191 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:58.468532 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-03fbcd76-7e1a-49a2-bcd0-f3d611ef2191 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:58.468981 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-03fbcd76-7e1a-49a2-bcd0-f3d611ef2191 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:58.469402 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-03fbcd76-7e1a-49a2-bcd0-f3d611ef2191 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:58.493648 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-03fbcd76-7e1a-49a2-bcd0-f3d611ef2191 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 16:39:58.792175 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-03fbcd76-7e1a-49a2-bcd0-f3d611ef2191 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 204 len: 0 microversion: 2.1 time: 0.335152 Sep 27 16:39:58.792788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 241/454] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:39:58 2022] DELETE /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 16:39:58.801743 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-80549fa1-2654-4490-b4ae-7def693d3bc9 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:58.802357 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-80549fa1-2654-4490-b4ae-7def693d3bc9 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:58.809408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-80549fa1-2654-4490-b4ae-7def693d3bc9 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:58.809895 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-80549fa1-2654-4490-b4ae-7def693d3bc9 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:58.810327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-80549fa1-2654-4490-b4ae-7def693d3bc9 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:58.811045 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-80549fa1-2654-4490-b4ae-7def693d3bc9 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:58.811501 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-80549fa1-2654-4490-b4ae-7def693d3bc9 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:58.811925 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-80549fa1-2654-4490-b4ae-7def693d3bc9 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:58.827583 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-07be4455-221f-4835-976a-1a0cfe71ecb4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:58.828319 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-07be4455-221f-4835-976a-1a0cfe71ecb4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:58.834190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07be4455-221f-4835-976a-1a0cfe71ecb4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:58.834907 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07be4455-221f-4835-976a-1a0cfe71ecb4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:58.835345 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07be4455-221f-4835-976a-1a0cfe71ecb4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:58.836046 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07be4455-221f-4835-976a-1a0cfe71ecb4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:58.836504 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07be4455-221f-4835-976a-1a0cfe71ecb4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:58.836926 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07be4455-221f-4835-976a-1a0cfe71ecb4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:59.016705 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-80549fa1-2654-4490-b4ae-7def693d3bc9 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:59.019662 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-07be4455-221f-4835-976a-1a0cfe71ecb4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:59.024666 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-80549fa1-2654-4490-b4ae-7def693d3bc9 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 200 len: 1680 microversion: 2.1 time: 0.226845 Sep 27 16:39:59.025235 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 214/455] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:58 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 1680 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:59.028879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-07be4455-221f-4835-976a-1a0cfe71ecb4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:59.030317 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-07be4455-221f-4835-976a-1a0cfe71ecb4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:59.031508 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-07be4455-221f-4835-976a-1a0cfe71ecb4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.208720 Sep 27 16:39:59.032054 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 242/456] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:39:58 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:39:59.159700 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-70dfeafe-8310-4bc6-bc48-f3ff28c55e71 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:59.160306 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-70dfeafe-8310-4bc6-bc48-f3ff28c55e71 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:59.162553 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:39:59.167223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-70dfeafe-8310-4bc6-bc48-f3ff28c55e71 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:59.167703 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-70dfeafe-8310-4bc6-bc48-f3ff28c55e71 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:59.168765 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-70dfeafe-8310-4bc6-bc48-f3ff28c55e71 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:59.169581 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-70dfeafe-8310-4bc6-bc48-f3ff28c55e71 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:59.170034 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-70dfeafe-8310-4bc6-bc48-f3ff28c55e71 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:59.170454 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-70dfeafe-8310-4bc6-bc48-f3ff28c55e71 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:59.231770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-70dfeafe-8310-4bc6-bc48-f3ff28c55e71 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:59.239593 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-70dfeafe-8310-4bc6-bc48-f3ff28c55e71 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1249 microversion: 2.1 time: 0.083956 Sep 27 16:39:59.240155 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 215/457] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:59 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:39:59.292650 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-95dc7c61-fc67-4a08-afe4-7e3880cbddf5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:39:59.293320 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-95dc7c61-fc67-4a08-afe4-7e3880cbddf5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:39:59.299359 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-95dc7c61-fc67-4a08-afe4-7e3880cbddf5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:59.299844 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-95dc7c61-fc67-4a08-afe4-7e3880cbddf5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:59.300324 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-95dc7c61-fc67-4a08-afe4-7e3880cbddf5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:59.301024 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-95dc7c61-fc67-4a08-afe4-7e3880cbddf5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:39:59.301480 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-95dc7c61-fc67-4a08-afe4-7e3880cbddf5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:39:59.301906 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-95dc7c61-fc67-4a08-afe4-7e3880cbddf5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:39:59.437349 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-95dc7c61-fc67-4a08-afe4-7e3880cbddf5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:39:59.444982 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-95dc7c61-fc67-4a08-afe4-7e3880cbddf5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1277 microversion: 2.1 time: 0.156096 Sep 27 16:39:59.445539 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 243/458] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:39:59 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:00.049951 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-93d912d3-e36f-4471-b7f8-bbf8094f233d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:00.050591 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-93d912d3-e36f-4471-b7f8-bbf8094f233d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:00.056566 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93d912d3-e36f-4471-b7f8-bbf8094f233d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:00.057028 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3f912dbb-c867-4789-973b-e713c76a54d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:00.057157 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93d912d3-e36f-4471-b7f8-bbf8094f233d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:00.057472 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93d912d3-e36f-4471-b7f8-bbf8094f233d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:00.057637 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3f912dbb-c867-4789-973b-e713c76a54d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:00.058270 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93d912d3-e36f-4471-b7f8-bbf8094f233d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:00.059276 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93d912d3-e36f-4471-b7f8-bbf8094f233d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:00.059716 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93d912d3-e36f-4471-b7f8-bbf8094f233d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:00.064818 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f912dbb-c867-4789-973b-e713c76a54d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:00.065298 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f912dbb-c867-4789-973b-e713c76a54d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:00.065727 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f912dbb-c867-4789-973b-e713c76a54d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:00.066422 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f912dbb-c867-4789-973b-e713c76a54d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:00.066903 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f912dbb-c867-4789-973b-e713c76a54d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:00.067325 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f912dbb-c867-4789-973b-e713c76a54d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:00.261663 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-93d912d3-e36f-4471-b7f8-bbf8094f233d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:00.262159 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3f912dbb-c867-4789-973b-e713c76a54d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:00.266879 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-93d912d3-e36f-4471-b7f8-bbf8094f233d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 200 len: 1680 microversion: 2.1 time: 0.220727 Sep 27 16:40:00.267551 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 216/459] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:00 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:00.270893 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3f912dbb-c867-4789-973b-e713c76a54d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:00.272072 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e6cd95ad-fae4-44f8-bfba-44e92791c164 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:00.272319 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3f912dbb-c867-4789-973b-e713c76a54d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:00.272808 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e6cd95ad-fae4-44f8-bfba-44e92791c164 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:00.273457 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3f912dbb-c867-4789-973b-e713c76a54d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.220293 Sep 27 16:40:00.274199 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 244/460] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:40:00 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:40:00.280503 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6cd95ad-fae4-44f8-bfba-44e92791c164 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:00.280986 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6cd95ad-fae4-44f8-bfba-44e92791c164 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:00.281420 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6cd95ad-fae4-44f8-bfba-44e92791c164 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:00.282115 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6cd95ad-fae4-44f8-bfba-44e92791c164 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:00.282568 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6cd95ad-fae4-44f8-bfba-44e92791c164 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:00.283026 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6cd95ad-fae4-44f8-bfba-44e92791c164 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:00.346797 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e6cd95ad-fae4-44f8-bfba-44e92791c164 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:00.354533 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e6cd95ad-fae4-44f8-bfba-44e92791c164 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1249 microversion: 2.1 time: 0.085955 Sep 27 16:40:00.355134 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 217/461] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:00 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:00.468674 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b048607c-7ebb-43dd-9b4f-f5bfdb19b89d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:00.469311 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b048607c-7ebb-43dd-9b4f-f5bfdb19b89d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:00.475236 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b048607c-7ebb-43dd-9b4f-f5bfdb19b89d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:00.475718 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b048607c-7ebb-43dd-9b4f-f5bfdb19b89d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:00.476149 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b048607c-7ebb-43dd-9b4f-f5bfdb19b89d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:00.476832 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b048607c-7ebb-43dd-9b4f-f5bfdb19b89d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:00.477284 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b048607c-7ebb-43dd-9b4f-f5bfdb19b89d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:00.477704 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b048607c-7ebb-43dd-9b4f-f5bfdb19b89d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:00.617373 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b048607c-7ebb-43dd-9b4f-f5bfdb19b89d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:00.625717 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b048607c-7ebb-43dd-9b4f-f5bfdb19b89d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1277 microversion: 2.1 time: 0.161378 Sep 27 16:40:00.626286 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 245/462] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:00 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:01.292363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-874fa846-a2f5-465d-a896-3ce76ac26ef6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:01.293011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-874fa846-a2f5-465d-a896-3ce76ac26ef6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:01.299717 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-874fa846-a2f5-465d-a896-3ce76ac26ef6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:01.300205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-874fa846-a2f5-465d-a896-3ce76ac26ef6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:01.300639 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-874fa846-a2f5-465d-a896-3ce76ac26ef6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:01.301321 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-874fa846-a2f5-465d-a896-3ce76ac26ef6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:01.301420 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-afa8d187-5f8c-4d76-b198-2dcfc77c0eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:01.301777 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-874fa846-a2f5-465d-a896-3ce76ac26ef6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:01.302010 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-afa8d187-5f8c-4d76-b198-2dcfc77c0eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:01.302195 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-874fa846-a2f5-465d-a896-3ce76ac26ef6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:01.310467 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afa8d187-5f8c-4d76-b198-2dcfc77c0eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:01.310467 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afa8d187-5f8c-4d76-b198-2dcfc77c0eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:01.310467 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afa8d187-5f8c-4d76-b198-2dcfc77c0eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:01.311064 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afa8d187-5f8c-4d76-b198-2dcfc77c0eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:01.311931 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afa8d187-5f8c-4d76-b198-2dcfc77c0eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:01.311931 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-afa8d187-5f8c-4d76-b198-2dcfc77c0eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:01.505620 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-874fa846-a2f5-465d-a896-3ce76ac26ef6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:01.510858 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-afa8d187-5f8c-4d76-b198-2dcfc77c0eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:01.514618 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-874fa846-a2f5-465d-a896-3ce76ac26ef6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 200 len: 1680 microversion: 2.1 time: 0.226041 Sep 27 16:40:01.515866 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 218/463] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:01 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 1680 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:01.521064 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-30e5a61b-3c97-443a-b0ff-8df859095b18 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:01.521950 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-30e5a61b-3c97-443a-b0ff-8df859095b18 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:01.522800 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-afa8d187-5f8c-4d76-b198-2dcfc77c0eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:01.524901 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-afa8d187-5f8c-4d76-b198-2dcfc77c0eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:01.526632 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-afa8d187-5f8c-4d76-b198-2dcfc77c0eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.229000 Sep 27 16:40:01.527582 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 246/464] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:40:01 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:40:01.533081 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-30e5a61b-3c97-443a-b0ff-8df859095b18 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:01.533081 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-30e5a61b-3c97-443a-b0ff-8df859095b18 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:01.533081 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-30e5a61b-3c97-443a-b0ff-8df859095b18 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:01.533081 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-30e5a61b-3c97-443a-b0ff-8df859095b18 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:01.534034 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-30e5a61b-3c97-443a-b0ff-8df859095b18 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:01.534034 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-30e5a61b-3c97-443a-b0ff-8df859095b18 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:01.598694 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-30e5a61b-3c97-443a-b0ff-8df859095b18 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:01.607607 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-30e5a61b-3c97-443a-b0ff-8df859095b18 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1249 microversion: 2.1 time: 0.090514 Sep 27 16:40:01.608537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 219/465] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:01 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1249 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:01.649023 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-da8ca0af-16db-4ead-a0fa-baf84b33e910 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:01.649634 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-da8ca0af-16db-4ead-a0fa-baf84b33e910 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:01.656607 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-da8ca0af-16db-4ead-a0fa-baf84b33e910 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:01.657097 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-da8ca0af-16db-4ead-a0fa-baf84b33e910 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:01.657542 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-da8ca0af-16db-4ead-a0fa-baf84b33e910 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:01.658217 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-da8ca0af-16db-4ead-a0fa-baf84b33e910 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:01.658997 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-da8ca0af-16db-4ead-a0fa-baf84b33e910 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:01.663322 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-da8ca0af-16db-4ead-a0fa-baf84b33e910 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:01.803480 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-da8ca0af-16db-4ead-a0fa-baf84b33e910 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:01.812849 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-da8ca0af-16db-4ead-a0fa-baf84b33e910 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1265 microversion: 2.1 time: 0.167757 Sep 27 16:40:01.814005 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 247/466] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:01 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:02.540764 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-774a3866-c538-4977-80dc-a1f8da137c50 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:02.541385 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-774a3866-c538-4977-80dc-a1f8da137c50 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:02.547919 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-774a3866-c538-4977-80dc-a1f8da137c50 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:02.553087 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-774a3866-c538-4977-80dc-a1f8da137c50 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:02.553087 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-774a3866-c538-4977-80dc-a1f8da137c50 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:02.553087 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-774a3866-c538-4977-80dc-a1f8da137c50 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:02.553087 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-774a3866-c538-4977-80dc-a1f8da137c50 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:02.553442 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-774a3866-c538-4977-80dc-a1f8da137c50 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:02.554856 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4cf61cfb-b101-4277-b6e3-4c4ff11dd521 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:02.555469 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4cf61cfb-b101-4277-b6e3-4c4ff11dd521 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:02.562183 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4cf61cfb-b101-4277-b6e3-4c4ff11dd521 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:02.562918 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4cf61cfb-b101-4277-b6e3-4c4ff11dd521 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:02.563601 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4cf61cfb-b101-4277-b6e3-4c4ff11dd521 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:02.564308 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4cf61cfb-b101-4277-b6e3-4c4ff11dd521 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:02.564670 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4cf61cfb-b101-4277-b6e3-4c4ff11dd521 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:02.565090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4cf61cfb-b101-4277-b6e3-4c4ff11dd521 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:02.754209 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-774a3866-c538-4977-80dc-a1f8da137c50 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:02.761177 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4cf61cfb-b101-4277-b6e3-4c4ff11dd521 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:02.762939 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-774a3866-c538-4977-80dc-a1f8da137c50 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 200 len: 1680 microversion: 2.1 time: 0.226180 Sep 27 16:40:02.763901 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 220/467] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:02 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 1680 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:02.768629 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f4c8ab5a-5f03-468c-a566-c7417b487a20 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:02.769568 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f4c8ab5a-5f03-468c-a566-c7417b487a20 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:02.772983 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4cf61cfb-b101-4277-b6e3-4c4ff11dd521 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:02.774450 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4cf61cfb-b101-4277-b6e3-4c4ff11dd521 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:02.775653 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4cf61cfb-b101-4277-b6e3-4c4ff11dd521 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.225666 Sep 27 16:40:02.776182 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4c8ab5a-5f03-468c-a566-c7417b487a20 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:02.776814 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4c8ab5a-5f03-468c-a566-c7417b487a20 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:02.777543 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4c8ab5a-5f03-468c-a566-c7417b487a20 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:02.778411 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4c8ab5a-5f03-468c-a566-c7417b487a20 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:02.779042 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4c8ab5a-5f03-468c-a566-c7417b487a20 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:02.779523 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 248/468] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:40:02 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:40:02.779958 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f4c8ab5a-5f03-468c-a566-c7417b487a20 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:02.837377 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e29f34c9-c58e-4302-bcc7-0f921a723695 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:02.837991 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e29f34c9-c58e-4302-bcc7-0f921a723695 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:02.843921 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f4c8ab5a-5f03-468c-a566-c7417b487a20 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:02.844182 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e29f34c9-c58e-4302-bcc7-0f921a723695 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:02.844569 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e29f34c9-c58e-4302-bcc7-0f921a723695 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:02.845042 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e29f34c9-c58e-4302-bcc7-0f921a723695 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:02.845741 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e29f34c9-c58e-4302-bcc7-0f921a723695 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:02.846200 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e29f34c9-c58e-4302-bcc7-0f921a723695 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:02.846624 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e29f34c9-c58e-4302-bcc7-0f921a723695 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:02.851707 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f4c8ab5a-5f03-468c-a566-c7417b487a20 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1249 microversion: 2.1 time: 0.086715 Sep 27 16:40:02.852275 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 221/469] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:02 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:02.984986 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e29f34c9-c58e-4302-bcc7-0f921a723695 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:02.992773 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e29f34c9-c58e-4302-bcc7-0f921a723695 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1265 microversion: 2.1 time: 0.159330 Sep 27 16:40:02.993341 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 249/470] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:02 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:40:03.788354 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f117f04a-0832-43e4-ad90-b2bffe55ddca tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:03.788899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f117f04a-0832-43e4-ad90-b2bffe55ddca tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:03.796200 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f117f04a-0832-43e4-ad90-b2bffe55ddca tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:03.796684 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f117f04a-0832-43e4-ad90-b2bffe55ddca tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:03.797111 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f117f04a-0832-43e4-ad90-b2bffe55ddca tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:03.797798 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f117f04a-0832-43e4-ad90-b2bffe55ddca tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:03.798245 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f117f04a-0832-43e4-ad90-b2bffe55ddca tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:03.798661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f117f04a-0832-43e4-ad90-b2bffe55ddca tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:03.801573 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bb7d6f02-7789-4efd-bd78-0c81d3857f11 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:03.802182 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bb7d6f02-7789-4efd-bd78-0c81d3857f11 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:03.809396 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb7d6f02-7789-4efd-bd78-0c81d3857f11 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:03.809917 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb7d6f02-7789-4efd-bd78-0c81d3857f11 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:03.810352 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb7d6f02-7789-4efd-bd78-0c81d3857f11 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:03.811132 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb7d6f02-7789-4efd-bd78-0c81d3857f11 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:03.817311 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb7d6f02-7789-4efd-bd78-0c81d3857f11 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:03.817311 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb7d6f02-7789-4efd-bd78-0c81d3857f11 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:03.817311 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:04.032210 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bb7d6f02-7789-4efd-bd78-0c81d3857f11 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:04.035640 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f117f04a-0832-43e4-ad90-b2bffe55ddca tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:04.041270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bb7d6f02-7789-4efd-bd78-0c81d3857f11 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:04.043357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bb7d6f02-7789-4efd-bd78-0c81d3857f11 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:04.043976 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f117f04a-0832-43e4-ad90-b2bffe55ddca tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 200 len: 1680 microversion: 2.1 time: 0.260102 Sep 27 16:40:04.044515 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bb7d6f02-7789-4efd-bd78-0c81d3857f11 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1808 microversion: 2.20 time: 0.246754 Sep 27 16:40:04.044641 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 222/471] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:03 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 1680 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:04.045055 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 250/472] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:40:03 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:40:04.049832 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f5c606d0-7cec-4643-b778-38819d50c9e5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:04.050686 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f5c606d0-7cec-4643-b778-38819d50c9e5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:04.054762 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8537e36c-8a10-4d5d-84a3-c2a8b189313e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:04.055393 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8537e36c-8a10-4d5d-84a3-c2a8b189313e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:04.056944 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5c606d0-7cec-4643-b778-38819d50c9e5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:04.057577 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5c606d0-7cec-4643-b778-38819d50c9e5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:04.058159 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5c606d0-7cec-4643-b778-38819d50c9e5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:04.059238 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5c606d0-7cec-4643-b778-38819d50c9e5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:04.059837 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5c606d0-7cec-4643-b778-38819d50c9e5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:04.060465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5c606d0-7cec-4643-b778-38819d50c9e5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:04.061693 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8537e36c-8a10-4d5d-84a3-c2a8b189313e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:04.062168 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8537e36c-8a10-4d5d-84a3-c2a8b189313e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:04.062605 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8537e36c-8a10-4d5d-84a3-c2a8b189313e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:04.063392 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8537e36c-8a10-4d5d-84a3-c2a8b189313e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:04.063963 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8537e36c-8a10-4d5d-84a3-c2a8b189313e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:04.064420 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8537e36c-8a10-4d5d-84a3-c2a8b189313e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:04.149701 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8537e36c-8a10-4d5d-84a3-c2a8b189313e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:04.157982 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8537e36c-8a10-4d5d-84a3-c2a8b189313e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1249 microversion: 2.1 time: 0.112494 Sep 27 16:40:04.158807 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 223/473] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:04 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1249 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:04.213525 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f5c606d0-7cec-4643-b778-38819d50c9e5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:04.221657 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f5c606d0-7cec-4643-b778-38819d50c9e5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1265 microversion: 2.1 time: 0.175365 Sep 27 16:40:04.222212 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 251/474] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:04 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:05.067833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d7aa9f05-e909-478c-8a50-f371d0670f4f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:05.068600 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d7aa9f05-e909-478c-8a50-f371d0670f4f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:05.069413 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d820ebca-dba4-4b54-bdc4-e63a90bd9ef6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:05.070172 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d820ebca-dba4-4b54-bdc4-e63a90bd9ef6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:05.075946 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7aa9f05-e909-478c-8a50-f371d0670f4f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:05.076443 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7aa9f05-e909-478c-8a50-f371d0670f4f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:05.076900 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7aa9f05-e909-478c-8a50-f371d0670f4f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:05.077572 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d820ebca-dba4-4b54-bdc4-e63a90bd9ef6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:05.077701 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7aa9f05-e909-478c-8a50-f371d0670f4f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:05.078054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7aa9f05-e909-478c-8a50-f371d0670f4f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:05.078165 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d820ebca-dba4-4b54-bdc4-e63a90bd9ef6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:05.078479 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7aa9f05-e909-478c-8a50-f371d0670f4f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:05.078611 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d820ebca-dba4-4b54-bdc4-e63a90bd9ef6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:05.079561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d820ebca-dba4-4b54-bdc4-e63a90bd9ef6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:05.080086 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d820ebca-dba4-4b54-bdc4-e63a90bd9ef6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:05.080710 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d820ebca-dba4-4b54-bdc4-e63a90bd9ef6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:05.297172 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d7aa9f05-e909-478c-8a50-f371d0670f4f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:05.301645 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d820ebca-dba4-4b54-bdc4-e63a90bd9ef6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:05.311621 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d820ebca-dba4-4b54-bdc4-e63a90bd9ef6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:05.313172 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d7aa9f05-e909-478c-8a50-f371d0670f4f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 200 len: 1680 microversion: 2.1 time: 0.244479 Sep 27 16:40:05.313801 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 224/475] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:05 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 1680 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:05.328110 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d820ebca-dba4-4b54-bdc4-e63a90bd9ef6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:05.332667 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d820ebca-dba4-4b54-bdc4-e63a90bd9ef6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1795 microversion: 2.20 time: 0.264463 Sep 27 16:40:05.333809 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 252/476] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:40:05 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1795 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:40:05.341353 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-00bdb846-34b9-4ba3-ab8b-53f65f63c0a9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:05.342209 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-00bdb846-34b9-4ba3-ab8b-53f65f63c0a9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:05.348585 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00bdb846-34b9-4ba3-ab8b-53f65f63c0a9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:05.349535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00bdb846-34b9-4ba3-ab8b-53f65f63c0a9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:05.350538 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-33ab0112-de11-46ee-95f8-93cb3ffcfdf3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:05.351215 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-33ab0112-de11-46ee-95f8-93cb3ffcfdf3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:05.351491 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00bdb846-34b9-4ba3-ab8b-53f65f63c0a9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:05.352447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00bdb846-34b9-4ba3-ab8b-53f65f63c0a9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:05.357873 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00bdb846-34b9-4ba3-ab8b-53f65f63c0a9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:05.358563 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00bdb846-34b9-4ba3-ab8b-53f65f63c0a9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:05.363527 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33ab0112-de11-46ee-95f8-93cb3ffcfdf3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:05.364203 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33ab0112-de11-46ee-95f8-93cb3ffcfdf3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:05.365127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33ab0112-de11-46ee-95f8-93cb3ffcfdf3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:05.367370 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33ab0112-de11-46ee-95f8-93cb3ffcfdf3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:05.368001 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33ab0112-de11-46ee-95f8-93cb3ffcfdf3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:05.370093 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33ab0112-de11-46ee-95f8-93cb3ffcfdf3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:05.453863 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-33ab0112-de11-46ee-95f8-93cb3ffcfdf3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:05.462282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-33ab0112-de11-46ee-95f8-93cb3ffcfdf3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1297 microversion: 2.1 time: 0.143952 Sep 27 16:40:05.463137 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 225/477] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:05 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1297 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:05.566849 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-00bdb846-34b9-4ba3-ab8b-53f65f63c0a9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:05.576242 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-00bdb846-34b9-4ba3-ab8b-53f65f63c0a9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1265 microversion: 2.1 time: 0.240582 Sep 27 16:40:05.577121 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 253/478] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:05 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:06.341247 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-df620314-85d4-4a66-aed0-bcdd5d715334 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:06.342578 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-df620314-85d4-4a66-aed0-bcdd5d715334 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:06.344511 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=4 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:06.345176 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=22 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:06.350677 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df620314-85d4-4a66-aed0-bcdd5d715334 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:06.351208 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df620314-85d4-4a66-aed0-bcdd5d715334 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:06.351641 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df620314-85d4-4a66-aed0-bcdd5d715334 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:06.352362 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df620314-85d4-4a66-aed0-bcdd5d715334 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:06.352809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df620314-85d4-4a66-aed0-bcdd5d715334 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:06.353225 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df620314-85d4-4a66-aed0-bcdd5d715334 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:06.417386 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-df620314-85d4-4a66-aed0-bcdd5d715334 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:06.421807 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:06.426697 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-df620314-85d4-4a66-aed0-bcdd5d715334 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 200 len: 1612 microversion: 2.1 time: 0.090207 Sep 27 16:40:06.427465 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 226/479] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:06 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 1612 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:06.490505 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b62d13ba-97a0-4218-b3fe-cdca5166823d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:06.491798 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b62d13ba-97a0-4218-b3fe-cdca5166823d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:06.498577 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b62d13ba-97a0-4218-b3fe-cdca5166823d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:06.503949 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b62d13ba-97a0-4218-b3fe-cdca5166823d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:06.503949 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b62d13ba-97a0-4218-b3fe-cdca5166823d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:06.503949 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b62d13ba-97a0-4218-b3fe-cdca5166823d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:06.503949 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b62d13ba-97a0-4218-b3fe-cdca5166823d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:06.504345 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b62d13ba-97a0-4218-b3fe-cdca5166823d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:06.524644 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-c37934d2-bbc3-4dbc-8874-e89152d95fff req-aa990f68-60f3-498b-bdd3-ab638f1f6631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2bb023b-8f1e-4e58-969b-e6c56395acca", "name": "network-vif-deleted", "tag": "2cce0dbb-eb5a-403b-b124-6df0f04b0136"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:40:06.539214 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-c37934d2-bbc3-4dbc-8874-e89152d95fff req-aa990f68-60f3-498b-bdd3-ab638f1f6631 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:06.544240 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-c37934d2-bbc3-4dbc-8874-e89152d95fff req-aa990f68-60f3-498b-bdd3-ab638f1f6631 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:06.544240 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-c37934d2-bbc3-4dbc-8874-e89152d95fff req-aa990f68-60f3-498b-bdd3-ab638f1f6631 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:06.557954 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-c37934d2-bbc3-4dbc-8874-e89152d95fff req-aa990f68-60f3-498b-bdd3-ab638f1f6631 service nova] Creating event network-vif-deleted:2cce0dbb-eb5a-403b-b124-6df0f04b0136 for instance c2bb023b-8f1e-4e58-969b-e6c56395acca on hv-cinder-85506 Sep 27 16:40:06.564214 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-c37934d2-bbc3-4dbc-8874-e89152d95fff req-aa990f68-60f3-498b-bdd3-ab638f1f6631 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045326 Sep 27 16:40:06.564980 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 227/480] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:40:06.574447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b62d13ba-97a0-4218-b3fe-cdca5166823d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:06.583563 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b62d13ba-97a0-4218-b3fe-cdca5166823d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1305 microversion: 2.1 time: 0.096795 Sep 27 16:40:06.584202 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 254/481] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:06 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:06.600207 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3ece5fdf-5d84-4de6-bd7a-cef93064ad56 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:06.601033 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3ece5fdf-5d84-4de6-bd7a-cef93064ad56 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:06.608639 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ece5fdf-5d84-4de6-bd7a-cef93064ad56 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:06.609133 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ece5fdf-5d84-4de6-bd7a-cef93064ad56 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:06.609639 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ece5fdf-5d84-4de6-bd7a-cef93064ad56 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:06.610356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ece5fdf-5d84-4de6-bd7a-cef93064ad56 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:06.610878 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ece5fdf-5d84-4de6-bd7a-cef93064ad56 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:06.611389 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ece5fdf-5d84-4de6-bd7a-cef93064ad56 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:06.762104 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3ece5fdf-5d84-4de6-bd7a-cef93064ad56 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:06.767174 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3ece5fdf-5d84-4de6-bd7a-cef93064ad56 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1265 microversion: 2.1 time: 0.171411 Sep 27 16:40:06.767757 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 228/482] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:06 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:07.451656 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-289a06f5-4a6b-4b7a-bb87-9276ff9a3d6b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:07.452239 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-289a06f5-4a6b-4b7a-bb87-9276ff9a3d6b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:07.458497 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-289a06f5-4a6b-4b7a-bb87-9276ff9a3d6b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:07.459031 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-289a06f5-4a6b-4b7a-bb87-9276ff9a3d6b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:07.459471 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-289a06f5-4a6b-4b7a-bb87-9276ff9a3d6b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:07.460176 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-289a06f5-4a6b-4b7a-bb87-9276ff9a3d6b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:07.460633 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-289a06f5-4a6b-4b7a-bb87-9276ff9a3d6b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:07.461064 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-289a06f5-4a6b-4b7a-bb87-9276ff9a3d6b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:07.525890 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-289a06f5-4a6b-4b7a-bb87-9276ff9a3d6b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:07.535438 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-289a06f5-4a6b-4b7a-bb87-9276ff9a3d6b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 200 len: 1612 microversion: 2.1 time: 0.088417 Sep 27 16:40:07.536335 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 255/483] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:07 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 1612 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:40:07.606755 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-99349f78-0ce3-42e6-8359-c0af086e33f1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:07.607492 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-99349f78-0ce3-42e6-8359-c0af086e33f1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:07.614105 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99349f78-0ce3-42e6-8359-c0af086e33f1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:07.614671 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99349f78-0ce3-42e6-8359-c0af086e33f1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:07.615201 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99349f78-0ce3-42e6-8359-c0af086e33f1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:07.615978 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99349f78-0ce3-42e6-8359-c0af086e33f1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:07.616508 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99349f78-0ce3-42e6-8359-c0af086e33f1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:07.617006 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99349f78-0ce3-42e6-8359-c0af086e33f1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:07.680429 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-99349f78-0ce3-42e6-8359-c0af086e33f1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:07.688324 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-99349f78-0ce3-42e6-8359-c0af086e33f1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1305 microversion: 2.1 time: 0.085585 Sep 27 16:40:07.688891 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 229/484] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:07 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1305 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:07.791819 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c5768ca6-c5b5-4413-b819-173e116236a4 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:07.792788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c5768ca6-c5b5-4413-b819-173e116236a4 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:07.799762 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5768ca6-c5b5-4413-b819-173e116236a4 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:07.800251 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5768ca6-c5b5-4413-b819-173e116236a4 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:07.800685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5768ca6-c5b5-4413-b819-173e116236a4 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:07.801422 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5768ca6-c5b5-4413-b819-173e116236a4 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:07.801871 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5768ca6-c5b5-4413-b819-173e116236a4 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:07.802343 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5768ca6-c5b5-4413-b819-173e116236a4 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:07.935665 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c5768ca6-c5b5-4413-b819-173e116236a4 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:07.943862 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c5768ca6-c5b5-4413-b819-173e116236a4 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1265 microversion: 2.1 time: 0.156485 Sep 27 16:40:07.944435 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 256/485] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:07 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:08.559318 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-35c2690b-bd3e-492a-bb0f-e1ee7c45c53b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:08.559908 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-35c2690b-bd3e-492a-bb0f-e1ee7c45c53b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:08.565926 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-35c2690b-bd3e-492a-bb0f-e1ee7c45c53b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:08.566400 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-35c2690b-bd3e-492a-bb0f-e1ee7c45c53b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:08.566855 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-35c2690b-bd3e-492a-bb0f-e1ee7c45c53b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:08.567536 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-35c2690b-bd3e-492a-bb0f-e1ee7c45c53b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:08.567981 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-35c2690b-bd3e-492a-bb0f-e1ee7c45c53b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:08.568393 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-35c2690b-bd3e-492a-bb0f-e1ee7c45c53b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:08.632486 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-35c2690b-bd3e-492a-bb0f-e1ee7c45c53b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:08.640405 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-35c2690b-bd3e-492a-bb0f-e1ee7c45c53b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 200 len: 1612 microversion: 2.1 time: 0.084993 Sep 27 16:40:08.640965 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 230/486] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:08 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 1612 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:08.711134 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f6c974ca-fd0f-4402-bedb-48896f1ad646 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:08.711799 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f6c974ca-fd0f-4402-bedb-48896f1ad646 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:08.718409 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6c974ca-fd0f-4402-bedb-48896f1ad646 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:08.718935 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6c974ca-fd0f-4402-bedb-48896f1ad646 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:08.719375 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6c974ca-fd0f-4402-bedb-48896f1ad646 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:08.720070 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6c974ca-fd0f-4402-bedb-48896f1ad646 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:08.720526 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6c974ca-fd0f-4402-bedb-48896f1ad646 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:08.720948 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6c974ca-fd0f-4402-bedb-48896f1ad646 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:08.784116 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f6c974ca-fd0f-4402-bedb-48896f1ad646 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:08.792096 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f6c974ca-fd0f-4402-bedb-48896f1ad646 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1305 microversion: 2.1 time: 0.084747 Sep 27 16:40:08.793282 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 257/487] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:08 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1305 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:08.968189 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0fa7848d-4be7-4e56-9b3d-59b56dc86a60 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:08.968827 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0fa7848d-4be7-4e56-9b3d-59b56dc86a60 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:08.974807 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fa7848d-4be7-4e56-9b3d-59b56dc86a60 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:08.975309 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fa7848d-4be7-4e56-9b3d-59b56dc86a60 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:08.975745 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fa7848d-4be7-4e56-9b3d-59b56dc86a60 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:08.976442 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fa7848d-4be7-4e56-9b3d-59b56dc86a60 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:08.976896 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fa7848d-4be7-4e56-9b3d-59b56dc86a60 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:08.977318 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fa7848d-4be7-4e56-9b3d-59b56dc86a60 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:09.118558 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0fa7848d-4be7-4e56-9b3d-59b56dc86a60 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:09.127022 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0fa7848d-4be7-4e56-9b3d-59b56dc86a60 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1265 microversion: 2.1 time: 0.163451 Sep 27 16:40:09.127609 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 231/488] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:08 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:09.664821 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0f94ff86-b7af-4d11-8c9a-7d087a317d59 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:09.666512 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0f94ff86-b7af-4d11-8c9a-7d087a317d59 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:09.673427 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f94ff86-b7af-4d11-8c9a-7d087a317d59 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:09.673832 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f94ff86-b7af-4d11-8c9a-7d087a317d59 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:09.674669 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f94ff86-b7af-4d11-8c9a-7d087a317d59 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:09.675259 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f94ff86-b7af-4d11-8c9a-7d087a317d59 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:09.675958 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f94ff86-b7af-4d11-8c9a-7d087a317d59 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:09.676387 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f94ff86-b7af-4d11-8c9a-7d087a317d59 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:09.713349 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f94ff86-b7af-4d11-8c9a-7d087a317d59 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:09.713998 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f94ff86-b7af-4d11-8c9a-7d087a317d59 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:09.714487 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f94ff86-b7af-4d11-8c9a-7d087a317d59 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:09.715755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-0f94ff86-b7af-4d11-8c9a-7d087a317d59 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lazy-loading 'fault' on Instance uuid c2bb023b-8f1e-4e58-969b-e6c56395acca {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:40:09.760002 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0f94ff86-b7af-4d11-8c9a-7d087a317d59 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:09.770249 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0f94ff86-b7af-4d11-8c9a-7d087a317d59 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 200 len: 1331 microversion: 2.1 time: 0.110149 Sep 27 16:40:09.786067 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 258/489] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:09 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 1331 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:09.817492 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-51536b54-639a-4b05-bf68-2601d76a9a0c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:09.819089 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-51536b54-639a-4b05-bf68-2601d76a9a0c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:09.826951 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-51536b54-639a-4b05-bf68-2601d76a9a0c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:09.827868 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-51536b54-639a-4b05-bf68-2601d76a9a0c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:09.828148 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-51536b54-639a-4b05-bf68-2601d76a9a0c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:09.828864 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-51536b54-639a-4b05-bf68-2601d76a9a0c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:09.829320 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-51536b54-639a-4b05-bf68-2601d76a9a0c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:09.829745 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-51536b54-639a-4b05-bf68-2601d76a9a0c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:09.942558 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-51536b54-639a-4b05-bf68-2601d76a9a0c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:09.952275 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-51536b54-639a-4b05-bf68-2601d76a9a0c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1303 microversion: 2.1 time: 0.140505 Sep 27 16:40:09.953096 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 232/490] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:09 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1303 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:10.150874 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-63e510a6-aa54-4b0c-8c9d-4d5c6f8b796a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:10.151629 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-63e510a6-aa54-4b0c-8c9d-4d5c6f8b796a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:10.158142 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63e510a6-aa54-4b0c-8c9d-4d5c6f8b796a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:10.158903 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63e510a6-aa54-4b0c-8c9d-4d5c6f8b796a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:10.159338 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63e510a6-aa54-4b0c-8c9d-4d5c6f8b796a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:10.160029 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63e510a6-aa54-4b0c-8c9d-4d5c6f8b796a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:10.160481 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63e510a6-aa54-4b0c-8c9d-4d5c6f8b796a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:10.160898 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63e510a6-aa54-4b0c-8c9d-4d5c6f8b796a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:10.310120 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-63e510a6-aa54-4b0c-8c9d-4d5c6f8b796a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:10.318246 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-63e510a6-aa54-4b0c-8c9d-4d5c6f8b796a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1265 microversion: 2.1 time: 0.171191 Sep 27 16:40:10.318891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 259/491] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:10 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:10.811984 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8c167483-5297-44d7-a60d-9ae128069e63 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:10.811984 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8c167483-5297-44d7-a60d-9ae128069e63 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:10.811984 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c167483-5297-44d7-a60d-9ae128069e63 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:10.811984 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c167483-5297-44d7-a60d-9ae128069e63 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:10.812873 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c167483-5297-44d7-a60d-9ae128069e63 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:10.812873 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c167483-5297-44d7-a60d-9ae128069e63 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:10.812873 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c167483-5297-44d7-a60d-9ae128069e63 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:10.812873 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c167483-5297-44d7-a60d-9ae128069e63 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:10.838862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c167483-5297-44d7-a60d-9ae128069e63 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:10.840558 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c167483-5297-44d7-a60d-9ae128069e63 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:10.840770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c167483-5297-44d7-a60d-9ae128069e63 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:10.841239 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-8c167483-5297-44d7-a60d-9ae128069e63 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lazy-loading 'fault' on Instance uuid c2bb023b-8f1e-4e58-969b-e6c56395acca {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:40:10.889276 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8c167483-5297-44d7-a60d-9ae128069e63 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:10.897694 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8c167483-5297-44d7-a60d-9ae128069e63 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 200 len: 1331 microversion: 2.1 time: 0.105783 Sep 27 16:40:10.898289 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 233/492] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:10 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:10.976114 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-20f15caa-1ca2-481a-879f-d653bdf11e78 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:10.976797 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-20f15caa-1ca2-481a-879f-d653bdf11e78 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:10.983979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20f15caa-1ca2-481a-879f-d653bdf11e78 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:10.984496 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20f15caa-1ca2-481a-879f-d653bdf11e78 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:10.984931 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20f15caa-1ca2-481a-879f-d653bdf11e78 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:10.985661 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20f15caa-1ca2-481a-879f-d653bdf11e78 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:10.986116 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20f15caa-1ca2-481a-879f-d653bdf11e78 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:10.986542 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20f15caa-1ca2-481a-879f-d653bdf11e78 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:11.144179 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-20f15caa-1ca2-481a-879f-d653bdf11e78 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:11.153810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-20f15caa-1ca2-481a-879f-d653bdf11e78 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1370 microversion: 2.1 time: 0.181505 Sep 27 16:40:11.154480 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 260/493] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:10 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:11.346210 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-693d4870-95dc-4a2e-ad5e-4dd08e4bf202 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:11.351907 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-693d4870-95dc-4a2e-ad5e-4dd08e4bf202 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:11.353867 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-693d4870-95dc-4a2e-ad5e-4dd08e4bf202 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:11.354347 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-693d4870-95dc-4a2e-ad5e-4dd08e4bf202 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:11.354790 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-693d4870-95dc-4a2e-ad5e-4dd08e4bf202 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:11.355833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-693d4870-95dc-4a2e-ad5e-4dd08e4bf202 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:11.356271 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-693d4870-95dc-4a2e-ad5e-4dd08e4bf202 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:11.356687 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-693d4870-95dc-4a2e-ad5e-4dd08e4bf202 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:11.439127 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-02b9941d-0b09-4ed2-9a15-59bec2ee0c9f req-72b7cb64-0833-47ec-a542-2e146dbe3917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c68417-b41c-4ab3-9fac-9e7087bfe731", "tag": "3886c674-6e5a-4ef4-b25f-926b0453292c"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:40:11.450230 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-02b9941d-0b09-4ed2-9a15-59bec2ee0c9f req-72b7cb64-0833-47ec-a542-2e146dbe3917 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:11.451104 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-02b9941d-0b09-4ed2-9a15-59bec2ee0c9f req-72b7cb64-0833-47ec-a542-2e146dbe3917 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:11.451629 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-02b9941d-0b09-4ed2-9a15-59bec2ee0c9f req-72b7cb64-0833-47ec-a542-2e146dbe3917 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:11.463606 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-02b9941d-0b09-4ed2-9a15-59bec2ee0c9f req-72b7cb64-0833-47ec-a542-2e146dbe3917 service nova] Creating event network-changed:3886c674-6e5a-4ef4-b25f-926b0453292c for instance 18c68417-b41c-4ab3-9fac-9e7087bfe731 on hv-cinder-85506 Sep 27 16:40:11.469471 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-02b9941d-0b09-4ed2-9a15-59bec2ee0c9f req-72b7cb64-0833-47ec-a542-2e146dbe3917 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034440 Sep 27 16:40:11.470155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 261/494] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:40:11.499670 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-693d4870-95dc-4a2e-ad5e-4dd08e4bf202 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:11.516037 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-693d4870-95dc-4a2e-ad5e-4dd08e4bf202 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1265 microversion: 2.1 time: 0.169243 Sep 27 16:40:11.516037 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 234/495] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:11 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:11.925725 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f75536bc-e232-4ee1-8396-7f7dc0b4994a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:11.926348 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f75536bc-e232-4ee1-8396-7f7dc0b4994a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:11.932483 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f75536bc-e232-4ee1-8396-7f7dc0b4994a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:11.932967 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f75536bc-e232-4ee1-8396-7f7dc0b4994a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:11.934112 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f75536bc-e232-4ee1-8396-7f7dc0b4994a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:11.934888 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f75536bc-e232-4ee1-8396-7f7dc0b4994a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:11.935346 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f75536bc-e232-4ee1-8396-7f7dc0b4994a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:11.935768 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f75536bc-e232-4ee1-8396-7f7dc0b4994a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:11.949535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-f75536bc-e232-4ee1-8396-7f7dc0b4994a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] HTTP exception thrown: Instance c2bb023b-8f1e-4e58-969b-e6c56395acca could not be found. Sep 27 16:40:11.951034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f75536bc-e232-4ee1-8396-7f7dc0b4994a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Request method failure captured: Sep 27 16:40:11.951034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca HTTP/1.1 Sep 27 16:40:11.951034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:40:11.951034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:40:11.951034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:40:11.951034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:40:11.951034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:40:11.951034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:40:11.951034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:40:11.951034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:40:11.951034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMyaXt7kpD0PfNVvLYuBuVZ7HRidwt4V7Ad9Ym3_Vbex0YLxAbLBHGS-HGBld9NGzCqyRTvioGgsu3eg4VIjDtZIgTd01qZ6DSQMCZ0BknQO4xdhtqMgcyIwM-7CdV1bNe00wPntnIGZvSkxLDfg4QN7aDekfETC-lFwzlHlACFvCF14 Sep 27 16:40:11.951034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:40:11.951034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:40:11.951034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:40:11.951034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:40:11.951034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:40:11.951034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:40:11.951034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:40:11.951034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:40:11.951034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:40:11.951034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:40:11.952491 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_73fad530905b485cb7141793f6130a9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/73fad530905b485cb7141793f6130a9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:40:11.952491 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:40:11.952491 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:40:11.952491 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:40:11.952491 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:40:11.952491 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:40:11.952491 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:40:11.952491 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: e8d3af2b82b641aea11ebf79677a3af1 Sep 27 16:40:11.952491 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:40:11.952491 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:40:11.952491 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Instance c2bb023b-8f1e-4e58-969b-e6c56395acca could not be found. Sep 27 16:40:11.952491 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': 'c2bb023b-8f1e-4e58-969b-e6c56395acca'} Sep 27 16:40:11.953306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:40:11.953306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:40:11.953306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:40:11.953306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:40:11.953306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:40:11.953306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:40:11.953306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:40:11.953306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:40:11.953306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:40:11.953306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:40:11.953306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2bb023b-8f1e-4e58-969b-e6c56395acca could not be found. Sep 27 16:40:11.953306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:40:11.953306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:40:11.953306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:40:11.953306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:40:11.953306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:40:11.953306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:40:11.953306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:40:11.953306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:40:11.953306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:40:11.954543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:40:11.954543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:40:11.954543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:40:11.954543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:40:11.954543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:40:11.954543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:40:11.954543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:40:11.954543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2bb023b-8f1e-4e58-969b-e6c56395acca could not be found. Sep 27 16:40:11.954543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:40:11.954543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:40:11.954543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:40:11.954543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:40:11.954543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:40:11.954543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:40:11.954543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:40:11.954543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:40:11.954543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2bb023b-8f1e-4e58-969b-e6c56395acca could not be found. Sep 27 16:40:11.954543 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:40:11.955655 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f75536bc-e232-4ee1-8396-7f7dc0b4994a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Returning 404 to user: Instance c2bb023b-8f1e-4e58-969b-e6c56395acca could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:40:11.955655 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f75536bc-e232-4ee1-8396-7f7dc0b4994a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 404 len: 111 microversion: 2.1 time: 0.031163 Sep 27 16:40:11.955655 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 262/496] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:11 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:40:11.961586 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2d1dc351-b97e-4086-82a4-0ae91a3eb3ea tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '.version_select at 0x7fa405a20ee0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:12.079196 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2d1dc351-b97e-4086-82a4-0ae91a3eb3ea tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1283862905" status: 202 len: 0 microversion: 2.1 time: 0.121386 Sep 27 16:40:12.080904 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 235/497] 10.222.0.64 () {58 vars in 1221 bytes} [Tue Sep 27 16:40:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1283862905 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:40:12.176333 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-dd0ea2ef-1034-4511-95c3-5b918aa45432 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:12.176903 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-dd0ea2ef-1034-4511-95c3-5b918aa45432 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:12.184493 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dd0ea2ef-1034-4511-95c3-5b918aa45432 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:12.184988 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dd0ea2ef-1034-4511-95c3-5b918aa45432 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:12.185618 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dd0ea2ef-1034-4511-95c3-5b918aa45432 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:12.186522 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dd0ea2ef-1034-4511-95c3-5b918aa45432 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:12.187019 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dd0ea2ef-1034-4511-95c3-5b918aa45432 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:12.187446 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dd0ea2ef-1034-4511-95c3-5b918aa45432 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:12.330980 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-dd0ea2ef-1034-4511-95c3-5b918aa45432 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:12.351075 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-dd0ea2ef-1034-4511-95c3-5b918aa45432 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1370 microversion: 2.1 time: 0.178491 Sep 27 16:40:12.351669 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 263/498] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:12 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:12.531345 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-464386ab-0e41-4d3b-a330-132204cc6aca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:12.532258 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-464386ab-0e41-4d3b-a330-132204cc6aca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:12.539310 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-464386ab-0e41-4d3b-a330-132204cc6aca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:12.539904 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-464386ab-0e41-4d3b-a330-132204cc6aca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:12.540404 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-464386ab-0e41-4d3b-a330-132204cc6aca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:12.541188 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-464386ab-0e41-4d3b-a330-132204cc6aca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:12.541705 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-464386ab-0e41-4d3b-a330-132204cc6aca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:12.542227 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-464386ab-0e41-4d3b-a330-132204cc6aca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:12.679475 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-464386ab-0e41-4d3b-a330-132204cc6aca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:12.687263 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-464386ab-0e41-4d3b-a330-132204cc6aca tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1265 microversion: 2.1 time: 0.160185 Sep 27 16:40:12.687841 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 236/499] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:12 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:13.003801 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-de53f586-d5dd-43ae-8461-a4de39d8a666 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:13.004302 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-de53f586-d5dd-43ae-8461-a4de39d8a666 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:13.010536 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-de53f586-d5dd-43ae-8461-a4de39d8a666 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:13.011069 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-de53f586-d5dd-43ae-8461-a4de39d8a666 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:13.012062 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-de53f586-d5dd-43ae-8461-a4de39d8a666 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:13.012769 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-de53f586-d5dd-43ae-8461-a4de39d8a666 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:13.013229 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-de53f586-d5dd-43ae-8461-a4de39d8a666 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:13.013657 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-de53f586-d5dd-43ae-8461-a4de39d8a666 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:13.138642 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-de53f586-d5dd-43ae-8461-a4de39d8a666 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lazy-loading 'services' on Instance uuid 8010c1e5-fe22-4255-a8df-0f63551bb226 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:40:13.374515 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6d5f5acf-d05c-4abf-8b40-f64acbbb06f6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:13.375224 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6d5f5acf-d05c-4abf-8b40-f64acbbb06f6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:13.381541 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d5f5acf-d05c-4abf-8b40-f64acbbb06f6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:13.382013 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d5f5acf-d05c-4abf-8b40-f64acbbb06f6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:13.382442 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d5f5acf-d05c-4abf-8b40-f64acbbb06f6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:13.383150 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d5f5acf-d05c-4abf-8b40-f64acbbb06f6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:13.383601 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d5f5acf-d05c-4abf-8b40-f64acbbb06f6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:13.384029 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d5f5acf-d05c-4abf-8b40-f64acbbb06f6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:13.392371 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-de53f586-d5dd-43ae-8461-a4de39d8a666 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226/os-volume_attachments/a6711ce7-ec46-495c-a651-72c6a6b1964e" status: 202 len: 0 microversion: 2.1 time: 0.392353 Sep 27 16:40:13.393290 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 264/500] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Sep 27 16:40:12 2022] DELETE /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226/os-volume_attachments/a6711ce7-ec46-495c-a651-72c6a6b1964e => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:40:13.401876 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b5f7eaa0-1f18-413f-8c4f-e9832c8577c7 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:13.404488 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b5f7eaa0-1f18-413f-8c4f-e9832c8577c7 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:13.411081 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5f7eaa0-1f18-413f-8c4f-e9832c8577c7 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:13.411556 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5f7eaa0-1f18-413f-8c4f-e9832c8577c7 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:13.412071 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5f7eaa0-1f18-413f-8c4f-e9832c8577c7 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:13.412828 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5f7eaa0-1f18-413f-8c4f-e9832c8577c7 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:13.413311 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5f7eaa0-1f18-413f-8c4f-e9832c8577c7 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:13.413735 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5f7eaa0-1f18-413f-8c4f-e9832c8577c7 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:13.449574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b5f7eaa0-1f18-413f-8c4f-e9832c8577c7 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051277 Sep 27 16:40:13.450020 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 265/501] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Sep 27 16:40:13 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:40:13.455483 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f7af4eb8-b09b-4215-a590-f6b13ed0b733 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:13.455971 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f7af4eb8-b09b-4215-a590-f6b13ed0b733 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:13.461951 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f7af4eb8-b09b-4215-a590-f6b13ed0b733 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:13.462433 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f7af4eb8-b09b-4215-a590-f6b13ed0b733 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:13.462889 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f7af4eb8-b09b-4215-a590-f6b13ed0b733 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:13.463581 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f7af4eb8-b09b-4215-a590-f6b13ed0b733 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:13.464028 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f7af4eb8-b09b-4215-a590-f6b13ed0b733 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:13.464548 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f7af4eb8-b09b-4215-a590-f6b13ed0b733 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:13.524031 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6d5f5acf-d05c-4abf-8b40-f64acbbb06f6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:13.534526 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6d5f5acf-d05c-4abf-8b40-f64acbbb06f6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1370 microversion: 2.1 time: 0.164445 Sep 27 16:40:13.535573 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 237/502] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:13 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:40:13.567970 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-f7af4eb8-b09b-4215-a590-f6b13ed0b733 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lazy-loading 'services' on Instance uuid ab77e6d5-1c27-420a-b7cd-b32c4f418dab {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:40:13.571563 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:13.710214 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-28548fde-9a2b-4543-b33e-4d65ef439646 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:13.714034 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-28548fde-9a2b-4543-b33e-4d65ef439646 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:13.717084 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28548fde-9a2b-4543-b33e-4d65ef439646 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:13.717566 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28548fde-9a2b-4543-b33e-4d65ef439646 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:13.717993 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28548fde-9a2b-4543-b33e-4d65ef439646 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:13.718685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28548fde-9a2b-4543-b33e-4d65ef439646 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:13.719158 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28548fde-9a2b-4543-b33e-4d65ef439646 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:13.720220 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28548fde-9a2b-4543-b33e-4d65ef439646 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:13.820958 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f7af4eb8-b09b-4215-a590-f6b13ed0b733 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab/os-volume_attachments/04e28c92-e1c6-434c-bed6-aed81e71ef52" status: 202 len: 0 microversion: 2.1 time: 0.369841 Sep 27 16:40:13.821547 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 266/503] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Sep 27 16:40:13 2022] DELETE /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab/os-volume_attachments/04e28c92-e1c6-434c-bed6-aed81e71ef52 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:40:13.856899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-28548fde-9a2b-4543-b33e-4d65ef439646 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:13.864551 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-28548fde-9a2b-4543-b33e-4d65ef439646 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1265 microversion: 2.1 time: 0.158321 Sep 27 16:40:13.865457 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 238/504] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:13 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:40:14.462539 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c8a49072-b16a-4d66-957d-4a9535537f19 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:14.465440 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c8a49072-b16a-4d66-957d-4a9535537f19 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:14.471640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c8a49072-b16a-4d66-957d-4a9535537f19 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:14.472125 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c8a49072-b16a-4d66-957d-4a9535537f19 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:14.472563 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c8a49072-b16a-4d66-957d-4a9535537f19 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:14.473250 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c8a49072-b16a-4d66-957d-4a9535537f19 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:14.473704 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c8a49072-b16a-4d66-957d-4a9535537f19 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:14.474128 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c8a49072-b16a-4d66-957d-4a9535537f19 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:14.503710 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c8a49072-b16a-4d66-957d-4a9535537f19 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045657 Sep 27 16:40:14.504345 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 267/505] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Sep 27 16:40:14 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:40:14.557357 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-230b2ef7-b84e-489a-add3-cd30ea58e508 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:14.558483 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-230b2ef7-b84e-489a-add3-cd30ea58e508 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:14.564960 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-230b2ef7-b84e-489a-add3-cd30ea58e508 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:14.565434 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-230b2ef7-b84e-489a-add3-cd30ea58e508 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:14.565858 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-230b2ef7-b84e-489a-add3-cd30ea58e508 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:14.566533 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-230b2ef7-b84e-489a-add3-cd30ea58e508 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:14.567005 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-230b2ef7-b84e-489a-add3-cd30ea58e508 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:14.567418 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-230b2ef7-b84e-489a-add3-cd30ea58e508 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:14.887915 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2426bce8-e199-4fc9-98e0-167cd51cd47f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:14.888539 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2426bce8-e199-4fc9-98e0-167cd51cd47f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:14.894847 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2426bce8-e199-4fc9-98e0-167cd51cd47f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:14.895364 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2426bce8-e199-4fc9-98e0-167cd51cd47f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:14.895796 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2426bce8-e199-4fc9-98e0-167cd51cd47f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:14.896684 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2426bce8-e199-4fc9-98e0-167cd51cd47f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:14.897134 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2426bce8-e199-4fc9-98e0-167cd51cd47f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:14.897557 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2426bce8-e199-4fc9-98e0-167cd51cd47f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:14.974995 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-230b2ef7-b84e-489a-add3-cd30ea58e508 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:14.983281 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-230b2ef7-b84e-489a-add3-cd30ea58e508 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1370 microversion: 2.1 time: 0.429720 Sep 27 16:40:14.983941 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 239/506] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:14 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1370 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:15.040412 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2426bce8-e199-4fc9-98e0-167cd51cd47f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:15.048905 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2426bce8-e199-4fc9-98e0-167cd51cd47f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1265 microversion: 2.1 time: 0.165695 Sep 27 16:40:15.049464 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 268/507] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:14 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:40:15.516215 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-baefaffe-b9a9-4270-be42-8d6dfaf68d9d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:15.519131 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-baefaffe-b9a9-4270-be42-8d6dfaf68d9d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:15.524667 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-baefaffe-b9a9-4270-be42-8d6dfaf68d9d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:15.525140 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-baefaffe-b9a9-4270-be42-8d6dfaf68d9d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:15.525567 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-baefaffe-b9a9-4270-be42-8d6dfaf68d9d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:15.526246 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-baefaffe-b9a9-4270-be42-8d6dfaf68d9d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:15.527222 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-baefaffe-b9a9-4270-be42-8d6dfaf68d9d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:15.527647 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-baefaffe-b9a9-4270-be42-8d6dfaf68d9d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:15.559118 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-baefaffe-b9a9-4270-be42-8d6dfaf68d9d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046762 Sep 27 16:40:15.559770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 240/508] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Sep 27 16:40:15 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:40:16.005386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-35c75658-1d27-4262-afce-ad7fe632309c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:16.006130 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-35c75658-1d27-4262-afce-ad7fe632309c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:16.012557 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35c75658-1d27-4262-afce-ad7fe632309c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:16.013041 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35c75658-1d27-4262-afce-ad7fe632309c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:16.013478 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35c75658-1d27-4262-afce-ad7fe632309c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:16.014163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35c75658-1d27-4262-afce-ad7fe632309c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:16.014621 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35c75658-1d27-4262-afce-ad7fe632309c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:16.015228 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35c75658-1d27-4262-afce-ad7fe632309c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:16.074673 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-07a74e13-3c0e-4094-b3ab-ee19866eeebe tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:16.074922 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-07a74e13-3c0e-4094-b3ab-ee19866eeebe tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:16.084742 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07a74e13-3c0e-4094-b3ab-ee19866eeebe tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:16.086171 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07a74e13-3c0e-4094-b3ab-ee19866eeebe tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:16.086742 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07a74e13-3c0e-4094-b3ab-ee19866eeebe tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:16.087443 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07a74e13-3c0e-4094-b3ab-ee19866eeebe tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:16.088047 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07a74e13-3c0e-4094-b3ab-ee19866eeebe tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:16.088397 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07a74e13-3c0e-4094-b3ab-ee19866eeebe tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:16.198511 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-35c75658-1d27-4262-afce-ad7fe632309c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:16.213057 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-35c75658-1d27-4262-afce-ad7fe632309c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1370 microversion: 2.1 time: 0.206966 Sep 27 16:40:16.213057 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 269/509] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:16 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:16.250893 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-07a74e13-3c0e-4094-b3ab-ee19866eeebe tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:16.260453 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-07a74e13-3c0e-4094-b3ab-ee19866eeebe tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1265 microversion: 2.1 time: 0.191831 Sep 27 16:40:16.270535 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 241/510] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:16 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:16.571649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-dda3e496-4d0a-4bc4-832e-0ace62684481 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:16.574008 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-dda3e496-4d0a-4bc4-832e-0ace62684481 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:16.579978 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dda3e496-4d0a-4bc4-832e-0ace62684481 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:16.580455 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dda3e496-4d0a-4bc4-832e-0ace62684481 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:16.580886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dda3e496-4d0a-4bc4-832e-0ace62684481 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:16.581564 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dda3e496-4d0a-4bc4-832e-0ace62684481 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:16.582013 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dda3e496-4d0a-4bc4-832e-0ace62684481 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:16.582430 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dda3e496-4d0a-4bc4-832e-0ace62684481 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:16.611297 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-dda3e496-4d0a-4bc4-832e-0ace62684481 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043548 Sep 27 16:40:16.618517 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 270/511] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Sep 27 16:40:16 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 16:40:16.676192 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-356cca00-c2d9-4ca3-9625-41ebc7e2c2ed tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:16.676738 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-356cca00-c2d9-4ca3-9625-41ebc7e2c2ed tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:16.682661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-356cca00-c2d9-4ca3-9625-41ebc7e2c2ed tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:16.685916 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-356cca00-c2d9-4ca3-9625-41ebc7e2c2ed tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:16.685916 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-356cca00-c2d9-4ca3-9625-41ebc7e2c2ed tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:16.685916 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-356cca00-c2d9-4ca3-9625-41ebc7e2c2ed tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:16.685916 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-356cca00-c2d9-4ca3-9625-41ebc7e2c2ed tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:16.686285 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-356cca00-c2d9-4ca3-9625-41ebc7e2c2ed tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:16.711395 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-356cca00-c2d9-4ca3-9625-41ebc7e2c2ed tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 16:40:17.015335 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-356cca00-c2d9-4ca3-9625-41ebc7e2c2ed tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 204 len: 0 microversion: 2.1 time: 0.342695 Sep 27 16:40:17.018255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 242/512] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:40:16 2022] DELETE /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 16:40:17.024126 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-21bb172c-e66d-45fb-ba3c-06c8046925e8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:17.024762 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-21bb172c-e66d-45fb-ba3c-06c8046925e8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:17.031702 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-21bb172c-e66d-45fb-ba3c-06c8046925e8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:17.032124 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-21bb172c-e66d-45fb-ba3c-06c8046925e8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:17.032595 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-21bb172c-e66d-45fb-ba3c-06c8046925e8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:17.033626 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-21bb172c-e66d-45fb-ba3c-06c8046925e8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:17.034263 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-21bb172c-e66d-45fb-ba3c-06c8046925e8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:17.034695 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-21bb172c-e66d-45fb-ba3c-06c8046925e8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:17.070989 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-50046784-0154-4f84-8842-35ccd5498ac5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:17.078628 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-50046784-0154-4f84-8842-35ccd5498ac5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:17.078628 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-50046784-0154-4f84-8842-35ccd5498ac5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:17.078628 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-50046784-0154-4f84-8842-35ccd5498ac5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:17.079018 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-50046784-0154-4f84-8842-35ccd5498ac5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:17.079610 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-50046784-0154-4f84-8842-35ccd5498ac5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:17.080057 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-50046784-0154-4f84-8842-35ccd5498ac5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:17.080472 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-50046784-0154-4f84-8842-35ccd5498ac5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:17.085102 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:17.108717 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-50046784-0154-4f84-8842-35ccd5498ac5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 16:40:17.170525 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-21bb172c-e66d-45fb-ba3c-06c8046925e8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:17.178346 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-21bb172c-e66d-45fb-ba3c-06c8046925e8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1681 microversion: 2.1 time: 0.158052 Sep 27 16:40:17.179131 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 271/513] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:17 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:17.231030 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d93f2957-7db5-45d5-908c-bd17d68dd14f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:17.231643 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d93f2957-7db5-45d5-908c-bd17d68dd14f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:17.237284 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d93f2957-7db5-45d5-908c-bd17d68dd14f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:17.237775 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d93f2957-7db5-45d5-908c-bd17d68dd14f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:17.238212 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d93f2957-7db5-45d5-908c-bd17d68dd14f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:17.238942 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d93f2957-7db5-45d5-908c-bd17d68dd14f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:17.239402 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d93f2957-7db5-45d5-908c-bd17d68dd14f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:17.239826 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d93f2957-7db5-45d5-908c-bd17d68dd14f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:17.369016 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d93f2957-7db5-45d5-908c-bd17d68dd14f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:17.377195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d93f2957-7db5-45d5-908c-bd17d68dd14f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1370 microversion: 2.1 time: 0.150055 Sep 27 16:40:17.377750 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 272/514] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:17 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:40:17.382051 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5baaa6fd-f6b9-455a-a503-012ffe7d4735 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:17.382656 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5baaa6fd-f6b9-455a-a503-012ffe7d4735 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:17.388663 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5baaa6fd-f6b9-455a-a503-012ffe7d4735 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:17.389140 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5baaa6fd-f6b9-455a-a503-012ffe7d4735 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:17.389573 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5baaa6fd-f6b9-455a-a503-012ffe7d4735 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:17.390256 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5baaa6fd-f6b9-455a-a503-012ffe7d4735 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:17.390705 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5baaa6fd-f6b9-455a-a503-012ffe7d4735 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:17.391160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5baaa6fd-f6b9-455a-a503-012ffe7d4735 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:17.438116 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-50046784-0154-4f84-8842-35ccd5498ac5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 204 len: 0 microversion: 2.1 time: 0.371336 Sep 27 16:40:17.438701 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 243/515] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:40:17 2022] DELETE /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 16:40:17.447152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0529278a-a993-4ef0-9861-96fbe3889a23 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:17.450246 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0529278a-a993-4ef0-9861-96fbe3889a23 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:17.454140 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0529278a-a993-4ef0-9861-96fbe3889a23 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:17.454616 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0529278a-a993-4ef0-9861-96fbe3889a23 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:17.455188 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0529278a-a993-4ef0-9861-96fbe3889a23 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:17.455876 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0529278a-a993-4ef0-9861-96fbe3889a23 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:17.456396 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0529278a-a993-4ef0-9861-96fbe3889a23 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:17.456814 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0529278a-a993-4ef0-9861-96fbe3889a23 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:17.565303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5baaa6fd-f6b9-455a-a503-012ffe7d4735 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:17.573392 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5baaa6fd-f6b9-455a-a503-012ffe7d4735 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1265 microversion: 2.1 time: 0.194586 Sep 27 16:40:17.575138 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 273/516] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:17 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:17.610508 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0529278a-a993-4ef0-9861-96fbe3889a23 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:17.618262 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0529278a-a993-4ef0-9861-96fbe3889a23 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 200 len: 1514 microversion: 2.1 time: 0.175014 Sep 27 16:40:17.618833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 244/517] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:17 2022] GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:40:18.202101 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d1e8d2fc-f82f-4714-b245-8b1a6ddb5b85 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:18.202723 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d1e8d2fc-f82f-4714-b245-8b1a6ddb5b85 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:18.208830 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d1e8d2fc-f82f-4714-b245-8b1a6ddb5b85 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:18.209314 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d1e8d2fc-f82f-4714-b245-8b1a6ddb5b85 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:18.209753 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d1e8d2fc-f82f-4714-b245-8b1a6ddb5b85 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:18.210455 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d1e8d2fc-f82f-4714-b245-8b1a6ddb5b85 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:18.210956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d1e8d2fc-f82f-4714-b245-8b1a6ddb5b85 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:18.211407 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d1e8d2fc-f82f-4714-b245-8b1a6ddb5b85 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:18.349106 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d1e8d2fc-f82f-4714-b245-8b1a6ddb5b85 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:18.357704 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d1e8d2fc-f82f-4714-b245-8b1a6ddb5b85 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1681 microversion: 2.1 time: 0.159576 Sep 27 16:40:18.358508 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 274/518] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:18 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:18.359918 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-b369af8b-cf9e-484e-a588-21030f156b2f req-2387c590-797d-4afc-aac4-6821029edb95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c68417-b41c-4ab3-9fac-9e7087bfe731", "name": "network-vif-plugged", "status": "completed", "tag": "3886c674-6e5a-4ef4-b25f-926b0453292c"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:40:18.371287 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-b369af8b-cf9e-484e-a588-21030f156b2f req-2387c590-797d-4afc-aac4-6821029edb95 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:18.371736 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-b369af8b-cf9e-484e-a588-21030f156b2f req-2387c590-797d-4afc-aac4-6821029edb95 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:18.372224 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-b369af8b-cf9e-484e-a588-21030f156b2f req-2387c590-797d-4afc-aac4-6821029edb95 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:18.384981 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-b369af8b-cf9e-484e-a588-21030f156b2f req-2387c590-797d-4afc-aac4-6821029edb95 service nova] Creating event network-vif-plugged:3886c674-6e5a-4ef4-b25f-926b0453292c for instance 18c68417-b41c-4ab3-9fac-9e7087bfe731 on hv-cinder-85506 Sep 27 16:40:18.390558 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-b369af8b-cf9e-484e-a588-21030f156b2f req-2387c590-797d-4afc-aac4-6821029edb95 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034377 Sep 27 16:40:18.391152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 245/519] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:40:18.400696 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cb0ee876-ac53-478a-a313-0fbef35085a2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:18.401336 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cb0ee876-ac53-478a-a313-0fbef35085a2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:18.407338 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb0ee876-ac53-478a-a313-0fbef35085a2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:18.407781 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb0ee876-ac53-478a-a313-0fbef35085a2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:18.408214 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb0ee876-ac53-478a-a313-0fbef35085a2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:18.409190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb0ee876-ac53-478a-a313-0fbef35085a2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:18.409832 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb0ee876-ac53-478a-a313-0fbef35085a2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:18.410260 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb0ee876-ac53-478a-a313-0fbef35085a2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:18.549344 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cb0ee876-ac53-478a-a313-0fbef35085a2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:18.557151 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cb0ee876-ac53-478a-a313-0fbef35085a2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1370 microversion: 2.1 time: 0.160202 Sep 27 16:40:18.557712 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 275/520] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:18 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:18.597613 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-69dd3302-8fe5-4bd7-b3e2-84e32af28afc tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:18.598344 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-69dd3302-8fe5-4bd7-b3e2-84e32af28afc tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:18.604524 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69dd3302-8fe5-4bd7-b3e2-84e32af28afc tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:18.605624 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69dd3302-8fe5-4bd7-b3e2-84e32af28afc tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:18.606069 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69dd3302-8fe5-4bd7-b3e2-84e32af28afc tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:18.606769 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69dd3302-8fe5-4bd7-b3e2-84e32af28afc tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:18.607400 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69dd3302-8fe5-4bd7-b3e2-84e32af28afc tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:18.607834 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69dd3302-8fe5-4bd7-b3e2-84e32af28afc tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:18.642137 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-dfbafcab-37f0-405c-ad23-d52fd3a58c71 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:18.642748 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-dfbafcab-37f0-405c-ad23-d52fd3a58c71 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:18.648906 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dfbafcab-37f0-405c-ad23-d52fd3a58c71 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:18.649343 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dfbafcab-37f0-405c-ad23-d52fd3a58c71 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:18.649788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dfbafcab-37f0-405c-ad23-d52fd3a58c71 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:18.650568 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dfbafcab-37f0-405c-ad23-d52fd3a58c71 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:18.651052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dfbafcab-37f0-405c-ad23-d52fd3a58c71 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:18.651481 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dfbafcab-37f0-405c-ad23-d52fd3a58c71 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:18.828278 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-69dd3302-8fe5-4bd7-b3e2-84e32af28afc tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:18.832318 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-dfbafcab-37f0-405c-ad23-d52fd3a58c71 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:18.836820 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-69dd3302-8fe5-4bd7-b3e2-84e32af28afc tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1265 microversion: 2.1 time: 0.243228 Sep 27 16:40:18.846815 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 246/521] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:18 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:18.847001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-dfbafcab-37f0-405c-ad23-d52fd3a58c71 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 200 len: 1514 microversion: 2.1 time: 0.203954 Sep 27 16:40:18.847001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 276/522] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:18 2022] GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:19.382577 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dc3efd07-be9b-4331-9be6-8656515e8081 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:19.383211 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-dc3efd07-be9b-4331-9be6-8656515e8081 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:19.389647 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc3efd07-be9b-4331-9be6-8656515e8081 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:19.390130 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc3efd07-be9b-4331-9be6-8656515e8081 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:19.390565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc3efd07-be9b-4331-9be6-8656515e8081 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:19.391304 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc3efd07-be9b-4331-9be6-8656515e8081 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:19.391757 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc3efd07-be9b-4331-9be6-8656515e8081 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:19.392181 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc3efd07-be9b-4331-9be6-8656515e8081 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:19.521305 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dc3efd07-be9b-4331-9be6-8656515e8081 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:19.529737 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-dc3efd07-be9b-4331-9be6-8656515e8081 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1681 microversion: 2.1 time: 0.150980 Sep 27 16:40:19.530299 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 247/523] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:19 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:19.579817 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f6ee5bfa-cb67-4f9c-8b95-af783bc149ed tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:19.580428 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f6ee5bfa-cb67-4f9c-8b95-af783bc149ed tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:19.586451 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6ee5bfa-cb67-4f9c-8b95-af783bc149ed tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:19.586969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6ee5bfa-cb67-4f9c-8b95-af783bc149ed tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:19.587403 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6ee5bfa-cb67-4f9c-8b95-af783bc149ed tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:19.588079 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6ee5bfa-cb67-4f9c-8b95-af783bc149ed tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:19.588526 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6ee5bfa-cb67-4f9c-8b95-af783bc149ed tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:19.588946 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6ee5bfa-cb67-4f9c-8b95-af783bc149ed tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:19.715803 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f6ee5bfa-cb67-4f9c-8b95-af783bc149ed tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:19.723641 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f6ee5bfa-cb67-4f9c-8b95-af783bc149ed tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1370 microversion: 2.1 time: 0.147552 Sep 27 16:40:19.724209 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 277/524] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:19 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:19.859202 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d20a5c98-7593-4e5f-a9ae-1a906f7a8162 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:19.859806 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d20a5c98-7593-4e5f-a9ae-1a906f7a8162 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:19.865215 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5c3b0fdd-bb55-43bb-80a6-2a3483682b75 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:19.865973 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5c3b0fdd-bb55-43bb-80a6-2a3483682b75 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:19.866491 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d20a5c98-7593-4e5f-a9ae-1a906f7a8162 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:19.867025 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d20a5c98-7593-4e5f-a9ae-1a906f7a8162 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:19.867467 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d20a5c98-7593-4e5f-a9ae-1a906f7a8162 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:19.867929 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:19.868169 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d20a5c98-7593-4e5f-a9ae-1a906f7a8162 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:19.868627 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d20a5c98-7593-4e5f-a9ae-1a906f7a8162 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:19.869051 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d20a5c98-7593-4e5f-a9ae-1a906f7a8162 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:19.873074 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c3b0fdd-bb55-43bb-80a6-2a3483682b75 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:19.873568 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c3b0fdd-bb55-43bb-80a6-2a3483682b75 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:19.874006 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c3b0fdd-bb55-43bb-80a6-2a3483682b75 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:19.874733 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c3b0fdd-bb55-43bb-80a6-2a3483682b75 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:19.875221 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c3b0fdd-bb55-43bb-80a6-2a3483682b75 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:19.875679 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c3b0fdd-bb55-43bb-80a6-2a3483682b75 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:20.064747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d20a5c98-7593-4e5f-a9ae-1a906f7a8162 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:20.072701 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d20a5c98-7593-4e5f-a9ae-1a906f7a8162 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1265 microversion: 2.1 time: 0.217443 Sep 27 16:40:20.073456 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 248/525] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:19 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:20.078129 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5c3b0fdd-bb55-43bb-80a6-2a3483682b75 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:20.086183 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5c3b0fdd-bb55-43bb-80a6-2a3483682b75 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 200 len: 1514 microversion: 2.1 time: 0.224762 Sep 27 16:40:20.088242 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 278/526] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:19 2022] GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 1514 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:40:20.407942 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-d461f16a-2524-4492-bb0b-45edd9ace80f req-07a96ffa-0edf-4e38-9424-4abba011af2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d959d05-2c44-4e4c-a8c0-9dd0b985b564", "name": "network-vif-plugged", "status": "completed", "tag": "52f691b3-ea75-4afe-9e42-e90c76a84965"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:40:20.423374 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-d461f16a-2524-4492-bb0b-45edd9ace80f req-07a96ffa-0edf-4e38-9424-4abba011af2e service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:20.423887 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-d461f16a-2524-4492-bb0b-45edd9ace80f req-07a96ffa-0edf-4e38-9424-4abba011af2e service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:20.424308 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-d461f16a-2524-4492-bb0b-45edd9ace80f req-07a96ffa-0edf-4e38-9424-4abba011af2e service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:20.436657 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-d461f16a-2524-4492-bb0b-45edd9ace80f req-07a96ffa-0edf-4e38-9424-4abba011af2e service nova] Creating event network-vif-plugged:52f691b3-ea75-4afe-9e42-e90c76a84965 for instance 3d959d05-2c44-4e4c-a8c0-9dd0b985b564 on hv-cinder-85506 Sep 27 16:40:20.441459 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-d461f16a-2524-4492-bb0b-45edd9ace80f req-07a96ffa-0edf-4e38-9424-4abba011af2e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038041 Sep 27 16:40:20.442054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 249/527] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:40:20.553579 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fd3986ee-0032-45f4-b67c-0224bfdc8b35 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:20.554104 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fd3986ee-0032-45f4-b67c-0224bfdc8b35 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:20.561099 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd3986ee-0032-45f4-b67c-0224bfdc8b35 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:20.561611 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd3986ee-0032-45f4-b67c-0224bfdc8b35 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:20.562107 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd3986ee-0032-45f4-b67c-0224bfdc8b35 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:20.562828 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd3986ee-0032-45f4-b67c-0224bfdc8b35 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:20.563294 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd3986ee-0032-45f4-b67c-0224bfdc8b35 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:20.563722 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd3986ee-0032-45f4-b67c-0224bfdc8b35 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:20.708263 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fd3986ee-0032-45f4-b67c-0224bfdc8b35 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:20.716274 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fd3986ee-0032-45f4-b67c-0224bfdc8b35 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1681 microversion: 2.1 time: 0.166628 Sep 27 16:40:20.717060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 279/528] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:20 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:20.746608 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ce65ed6a-d435-47fd-af9c-0818aa7c6709 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:20.747849 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ce65ed6a-d435-47fd-af9c-0818aa7c6709 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:20.753760 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce65ed6a-d435-47fd-af9c-0818aa7c6709 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:20.754223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce65ed6a-d435-47fd-af9c-0818aa7c6709 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:20.754662 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce65ed6a-d435-47fd-af9c-0818aa7c6709 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:20.755390 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce65ed6a-d435-47fd-af9c-0818aa7c6709 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:20.755850 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce65ed6a-d435-47fd-af9c-0818aa7c6709 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:20.756277 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce65ed6a-d435-47fd-af9c-0818aa7c6709 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:20.888294 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ce65ed6a-d435-47fd-af9c-0818aa7c6709 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:20.896034 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ce65ed6a-d435-47fd-af9c-0818aa7c6709 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1370 microversion: 2.1 time: 0.154250 Sep 27 16:40:20.896604 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 250/529] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:20 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:21.096225 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3f39de1c-1367-41bd-9084-30bfee353863 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:21.096917 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3f39de1c-1367-41bd-9084-30bfee353863 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:21.103166 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f39de1c-1367-41bd-9084-30bfee353863 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:21.103736 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f39de1c-1367-41bd-9084-30bfee353863 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:21.104241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f39de1c-1367-41bd-9084-30bfee353863 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:21.105571 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f39de1c-1367-41bd-9084-30bfee353863 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:21.106100 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f39de1c-1367-41bd-9084-30bfee353863 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:21.106594 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f39de1c-1367-41bd-9084-30bfee353863 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:21.122053 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-97eaf983-175b-48a2-a98a-3630597578ff tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:21.123033 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-97eaf983-175b-48a2-a98a-3630597578ff tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:21.131904 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97eaf983-175b-48a2-a98a-3630597578ff tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:21.132900 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97eaf983-175b-48a2-a98a-3630597578ff tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:21.133701 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97eaf983-175b-48a2-a98a-3630597578ff tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:21.134707 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97eaf983-175b-48a2-a98a-3630597578ff tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:21.135366 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97eaf983-175b-48a2-a98a-3630597578ff tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:21.136535 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97eaf983-175b-48a2-a98a-3630597578ff tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:21.336594 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3f39de1c-1367-41bd-9084-30bfee353863 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:21.342682 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-97eaf983-175b-48a2-a98a-3630597578ff tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:21.346605 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3f39de1c-1367-41bd-9084-30bfee353863 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1265 microversion: 2.1 time: 0.254370 Sep 27 16:40:21.347270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 280/530] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:21 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:21.360483 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-97eaf983-175b-48a2-a98a-3630597578ff tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 200 len: 1514 microversion: 2.1 time: 0.244956 Sep 27 16:40:21.361416 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 251/531] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:21 2022] GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:21.740572 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5c19e808-932b-4cab-bfeb-5c231ca1ce35 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:21.741330 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5c19e808-932b-4cab-bfeb-5c231ca1ce35 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:21.747790 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c19e808-932b-4cab-bfeb-5c231ca1ce35 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:21.748406 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c19e808-932b-4cab-bfeb-5c231ca1ce35 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:21.748941 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c19e808-932b-4cab-bfeb-5c231ca1ce35 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:21.749738 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c19e808-932b-4cab-bfeb-5c231ca1ce35 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:21.750482 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c19e808-932b-4cab-bfeb-5c231ca1ce35 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:21.751024 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c19e808-932b-4cab-bfeb-5c231ca1ce35 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:21.885617 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5c19e808-932b-4cab-bfeb-5c231ca1ce35 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:21.894583 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5c19e808-932b-4cab-bfeb-5c231ca1ce35 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1681 microversion: 2.1 time: 0.158395 Sep 27 16:40:21.895418 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 281/532] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:21 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:21.920056 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ceeb7ed8-ed48-40af-a251-c02af83b967e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:21.920572 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ceeb7ed8-ed48-40af-a251-c02af83b967e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:21.927369 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ceeb7ed8-ed48-40af-a251-c02af83b967e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:21.927859 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ceeb7ed8-ed48-40af-a251-c02af83b967e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:21.928294 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ceeb7ed8-ed48-40af-a251-c02af83b967e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:21.929269 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ceeb7ed8-ed48-40af-a251-c02af83b967e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:21.929724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ceeb7ed8-ed48-40af-a251-c02af83b967e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:21.930146 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ceeb7ed8-ed48-40af-a251-c02af83b967e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:22.063910 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ceeb7ed8-ed48-40af-a251-c02af83b967e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:22.072099 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ceeb7ed8-ed48-40af-a251-c02af83b967e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1370 microversion: 2.1 time: 0.156335 Sep 27 16:40:22.076137 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 252/533] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:21 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:22.257143 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-f37418b5-0bec-4f0b-9dc5-6d7beed3352c req-bda9c7e7-624b-4ba7-92e0-7d815bd4f978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab77e6d5-1c27-420a-b7cd-b32c4f418dab", "name": "network-vif-deleted", "tag": "b076a24a-f4ef-4eb2-b560-505f54ef1e3d"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:40:22.267088 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-f37418b5-0bec-4f0b-9dc5-6d7beed3352c req-bda9c7e7-624b-4ba7-92e0-7d815bd4f978 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:22.267584 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-f37418b5-0bec-4f0b-9dc5-6d7beed3352c req-bda9c7e7-624b-4ba7-92e0-7d815bd4f978 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:22.268013 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-f37418b5-0bec-4f0b-9dc5-6d7beed3352c req-bda9c7e7-624b-4ba7-92e0-7d815bd4f978 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:22.280387 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-f37418b5-0bec-4f0b-9dc5-6d7beed3352c req-bda9c7e7-624b-4ba7-92e0-7d815bd4f978 service nova] Creating event network-vif-deleted:b076a24a-f4ef-4eb2-b560-505f54ef1e3d for instance ab77e6d5-1c27-420a-b7cd-b32c4f418dab on hv-cinder-85506 Sep 27 16:40:22.285818 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-f37418b5-0bec-4f0b-9dc5-6d7beed3352c req-bda9c7e7-624b-4ba7-92e0-7d815bd4f978 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032677 Sep 27 16:40:22.286433 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 282/534] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:40:22.369541 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a03c6fa3-0e7a-4c35-9292-de648b931528 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:22.370142 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a03c6fa3-0e7a-4c35-9292-de648b931528 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:22.376286 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a03c6fa3-0e7a-4c35-9292-de648b931528 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:22.376818 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a03c6fa3-0e7a-4c35-9292-de648b931528 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:22.377245 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a03c6fa3-0e7a-4c35-9292-de648b931528 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:22.377932 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a03c6fa3-0e7a-4c35-9292-de648b931528 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:22.378386 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a03c6fa3-0e7a-4c35-9292-de648b931528 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:22.379146 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a03c6fa3-0e7a-4c35-9292-de648b931528 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:22.384218 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-572fc3bb-7246-43b3-a8c0-5240c10a6b12 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:22.385140 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-572fc3bb-7246-43b3-a8c0-5240c10a6b12 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:22.392301 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-572fc3bb-7246-43b3-a8c0-5240c10a6b12 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:22.392806 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-572fc3bb-7246-43b3-a8c0-5240c10a6b12 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:22.393858 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-572fc3bb-7246-43b3-a8c0-5240c10a6b12 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:22.394812 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-572fc3bb-7246-43b3-a8c0-5240c10a6b12 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:22.395809 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-572fc3bb-7246-43b3-a8c0-5240c10a6b12 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:22.396252 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-572fc3bb-7246-43b3-a8c0-5240c10a6b12 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:22.501224 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-572fc3bb-7246-43b3-a8c0-5240c10a6b12 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:22.515838 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:22.519165 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-572fc3bb-7246-43b3-a8c0-5240c10a6b12 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 200 len: 1472 microversion: 2.1 time: 0.138806 Sep 27 16:40:22.520284 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 283/535] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:22 2022] GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 1472 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:40:22.568074 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a03c6fa3-0e7a-4c35-9292-de648b931528 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:22.581968 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a03c6fa3-0e7a-4c35-9292-de648b931528 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1265 microversion: 2.1 time: 0.215328 Sep 27 16:40:22.585522 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 253/536] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:22 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:22.920092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b46d9d93-bf0b-49f9-8871-f276d1957b41 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:22.920851 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b46d9d93-bf0b-49f9-8871-f276d1957b41 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:22.934653 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b46d9d93-bf0b-49f9-8871-f276d1957b41 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:22.935185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b46d9d93-bf0b-49f9-8871-f276d1957b41 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:22.935630 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b46d9d93-bf0b-49f9-8871-f276d1957b41 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:22.936350 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b46d9d93-bf0b-49f9-8871-f276d1957b41 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:22.936814 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b46d9d93-bf0b-49f9-8871-f276d1957b41 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:22.943082 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b46d9d93-bf0b-49f9-8871-f276d1957b41 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:23.014938 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b46d9d93-bf0b-49f9-8871-f276d1957b41 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:23.023513 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b46d9d93-bf0b-49f9-8871-f276d1957b41 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1614 microversion: 2.1 time: 0.108120 Sep 27 16:40:23.024080 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 284/537] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:22 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1614 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:40:23.095226 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-078bbd7f-324a-48f1-892f-2a80433300e1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:23.095908 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-078bbd7f-324a-48f1-892f-2a80433300e1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:23.102608 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-078bbd7f-324a-48f1-892f-2a80433300e1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:23.103121 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-078bbd7f-324a-48f1-892f-2a80433300e1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:23.103741 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-078bbd7f-324a-48f1-892f-2a80433300e1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:23.104520 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-078bbd7f-324a-48f1-892f-2a80433300e1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:23.105040 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-078bbd7f-324a-48f1-892f-2a80433300e1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:23.105460 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-078bbd7f-324a-48f1-892f-2a80433300e1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:23.244019 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-078bbd7f-324a-48f1-892f-2a80433300e1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:23.254720 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-078bbd7f-324a-48f1-892f-2a80433300e1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1564 microversion: 2.1 time: 0.163305 Sep 27 16:40:23.255641 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 254/538] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:23 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:23.277279 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b7083fde-fe27-44f3-8d87-2dc86dc758eb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:23.277764 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b7083fde-fe27-44f3-8d87-2dc86dc758eb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:23.286841 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7083fde-fe27-44f3-8d87-2dc86dc758eb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:23.286841 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7083fde-fe27-44f3-8d87-2dc86dc758eb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:23.286841 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7083fde-fe27-44f3-8d87-2dc86dc758eb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:23.286841 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7083fde-fe27-44f3-8d87-2dc86dc758eb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:23.287190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7083fde-fe27-44f3-8d87-2dc86dc758eb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:23.287190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7083fde-fe27-44f3-8d87-2dc86dc758eb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:23.368011 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b7083fde-fe27-44f3-8d87-2dc86dc758eb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094784 Sep 27 16:40:23.368605 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 285/539] 10.222.0.64 () {58 vars in 1275 bytes} [Tue Sep 27 16:40:23 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:40:23.543920 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4deade23-a7f2-4925-aa5f-6422a6fc94d5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:23.544766 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4deade23-a7f2-4925-aa5f-6422a6fc94d5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:23.553004 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4deade23-a7f2-4925-aa5f-6422a6fc94d5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:23.555735 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4deade23-a7f2-4925-aa5f-6422a6fc94d5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:23.560276 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4deade23-a7f2-4925-aa5f-6422a6fc94d5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:23.561214 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4deade23-a7f2-4925-aa5f-6422a6fc94d5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:23.561687 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4deade23-a7f2-4925-aa5f-6422a6fc94d5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:23.562118 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4deade23-a7f2-4925-aa5f-6422a6fc94d5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:23.598489 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4deade23-a7f2-4925-aa5f-6422a6fc94d5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:23.599008 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4deade23-a7f2-4925-aa5f-6422a6fc94d5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:23.599439 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4deade23-a7f2-4925-aa5f-6422a6fc94d5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:23.599950 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-4deade23-a7f2-4925-aa5f-6422a6fc94d5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lazy-loading 'fault' on Instance uuid ab77e6d5-1c27-420a-b7cd-b32c4f418dab {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:40:23.607319 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-24c30005-287e-4f70-a20b-65878b817cc9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:23.607986 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-24c30005-287e-4f70-a20b-65878b817cc9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:23.617472 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-24c30005-287e-4f70-a20b-65878b817cc9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:23.621846 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-24c30005-287e-4f70-a20b-65878b817cc9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:23.621846 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-24c30005-287e-4f70-a20b-65878b817cc9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:23.624619 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-24c30005-287e-4f70-a20b-65878b817cc9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:23.624905 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-24c30005-287e-4f70-a20b-65878b817cc9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:23.625336 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-24c30005-287e-4f70-a20b-65878b817cc9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:23.693142 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4deade23-a7f2-4925-aa5f-6422a6fc94d5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:23.703052 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4deade23-a7f2-4925-aa5f-6422a6fc94d5 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 200 len: 1309 microversion: 2.1 time: 0.163498 Sep 27 16:40:23.714990 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 255/540] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:23 2022] GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 1309 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:23.944666 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-24c30005-287e-4f70-a20b-65878b817cc9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:23.952746 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-24c30005-287e-4f70-a20b-65878b817cc9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1452 microversion: 2.1 time: 0.349895 Sep 27 16:40:23.953247 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 286/541] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:23 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1452 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:23.974942 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9229717c-6661-4ef0-9c6d-9bed8a4de68b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:23.975551 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9229717c-6661-4ef0-9c6d-9bed8a4de68b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:23.977535 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:23.983484 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9229717c-6661-4ef0-9c6d-9bed8a4de68b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:23.983996 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9229717c-6661-4ef0-9c6d-9bed8a4de68b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:23.984496 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9229717c-6661-4ef0-9c6d-9bed8a4de68b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:23.985196 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9229717c-6661-4ef0-9c6d-9bed8a4de68b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:23.988711 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9229717c-6661-4ef0-9c6d-9bed8a4de68b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:23.988711 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9229717c-6661-4ef0-9c6d-9bed8a4de68b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:24.048303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d79fe6f9-d2c8-4bfc-8ece-9fb8510fd731 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:24.048984 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d79fe6f9-d2c8-4bfc-8ece-9fb8510fd731 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:24.055328 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d79fe6f9-d2c8-4bfc-8ece-9fb8510fd731 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:24.055818 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d79fe6f9-d2c8-4bfc-8ece-9fb8510fd731 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:24.056252 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d79fe6f9-d2c8-4bfc-8ece-9fb8510fd731 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:24.056950 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d79fe6f9-d2c8-4bfc-8ece-9fb8510fd731 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:24.057488 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d79fe6f9-d2c8-4bfc-8ece-9fb8510fd731 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:24.058854 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d79fe6f9-d2c8-4bfc-8ece-9fb8510fd731 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:24.094856 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d79fe6f9-d2c8-4bfc-8ece-9fb8510fd731 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:24.095365 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d79fe6f9-d2c8-4bfc-8ece-9fb8510fd731 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:24.095838 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d79fe6f9-d2c8-4bfc-8ece-9fb8510fd731 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:24.097825 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-d79fe6f9-d2c8-4bfc-8ece-9fb8510fd731 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lazy-loading 'fault' on Instance uuid 8010c1e5-fe22-4255-a8df-0f63551bb226 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:40:24.166486 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d79fe6f9-d2c8-4bfc-8ece-9fb8510fd731 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:24.175284 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d79fe6f9-d2c8-4bfc-8ece-9fb8510fd731 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1331 microversion: 2.1 time: 0.130839 Sep 27 16:40:24.175876 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 287/542] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:24 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1331 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:40:24.234268 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9229717c-6661-4ef0-9c6d-9bed8a4de68b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:24.248684 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9229717c-6661-4ef0-9c6d-9bed8a4de68b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1452 microversion: 2.1 time: 0.277581 Sep 27 16:40:24.249399 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 256/543] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:23 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1452 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:24.315909 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-9be7a7b6-eef8-4053-9ff4-bc44374e79f9 req-0d71561c-e7ae-42ec-a97b-e44773aa9433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8010c1e5-fe22-4255-a8df-0f63551bb226", "name": "network-vif-deleted", "tag": "28c38995-7f8b-4c47-85ed-9090cbdf348e"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:40:24.326613 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-9be7a7b6-eef8-4053-9ff4-bc44374e79f9 req-0d71561c-e7ae-42ec-a97b-e44773aa9433 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:24.327546 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-9be7a7b6-eef8-4053-9ff4-bc44374e79f9 req-0d71561c-e7ae-42ec-a97b-e44773aa9433 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:24.328209 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-9be7a7b6-eef8-4053-9ff4-bc44374e79f9 req-0d71561c-e7ae-42ec-a97b-e44773aa9433 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:24.343816 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-9be7a7b6-eef8-4053-9ff4-bc44374e79f9 req-0d71561c-e7ae-42ec-a97b-e44773aa9433 service nova] Creating event network-vif-deleted:28c38995-7f8b-4c47-85ed-9090cbdf348e for instance 8010c1e5-fe22-4255-a8df-0f63551bb226 on hv-cinder-85506 Sep 27 16:40:24.351560 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-9be7a7b6-eef8-4053-9ff4-bc44374e79f9 req-0d71561c-e7ae-42ec-a97b-e44773aa9433 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037991 Sep 27 16:40:24.352984 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 288/544] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:40:24.733466 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bb52c53d-959b-483e-a343-aabd60d901c6 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:24.734345 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bb52c53d-959b-483e-a343-aabd60d901c6 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: ab77e6d5-1c27-420a-b7cd-b32c4f418dab] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:24.740925 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb52c53d-959b-483e-a343-aabd60d901c6 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:24.742022 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb52c53d-959b-483e-a343-aabd60d901c6 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:24.743570 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb52c53d-959b-483e-a343-aabd60d901c6 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:24.745192 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb52c53d-959b-483e-a343-aabd60d901c6 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:24.745978 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb52c53d-959b-483e-a343-aabd60d901c6 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:24.746628 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb52c53d-959b-483e-a343-aabd60d901c6 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:24.764649 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-bb52c53d-959b-483e-a343-aabd60d901c6 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] HTTP exception thrown: Instance ab77e6d5-1c27-420a-b7cd-b32c4f418dab could not be found. Sep 27 16:40:24.766525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bb52c53d-959b-483e-a343-aabd60d901c6 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Request method failure captured: Sep 27 16:40:24.766525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab HTTP/1.1 Sep 27 16:40:24.766525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:40:24.766525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:40:24.766525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:40:24.766525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 27 16:40:24.766525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:40:24.766525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:40:24.766525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:40:24.766525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:40:24.766525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMycLxVj26daLJJOzcGppVjF9xxPXwFfxAEvhBgk6NlRvcnzna241lO0RmFYfRMdEQfA6pxoOKjAGD5tW8jWeWMnkPElZAYQ9K72-5-QAZqWuiaqcY5zPQKm9xxr2UHxKUOatrax5V5nDgEuM9diq-vZiUgKB6tSuM9dGsbQ-2gtUAgQ Sep 27 16:40:24.766525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:40:24.766525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:40:24.766525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:40:24.766525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:40:24.766525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:40:24.766525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:40:24.766525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: a06947e0733946bb8e266382c0d4d0ce Sep 27 16:40:24.766525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesSnapshotTestJSON-781298834 Sep 27 16:40:24.766525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:40:24.766525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:40:24.767848 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a06947e0733946bb8e266382c0d4d0ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a06947e0733946bb8e266382c0d4d0ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a06947e0733946bb8e266382c0d4d0ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a06947e0733946bb8e266382c0d4d0ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:40:24.767848 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesSnapshotTestJSON-781298834 Sep 27 16:40:24.767848 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: a06947e0733946bb8e266382c0d4d0ce Sep 27 16:40:24.767848 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-781298834 Sep 27 16:40:24.767848 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesSnapshotTestJSON-781298834-project Sep 27 16:40:24.767848 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:40:24.767848 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:40:24.767848 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: 211efc6d124344c0b6ba83c378425df0 Sep 27 16:40:24.767848 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesSnapshotTestJSON-781298834-project Sep 27 16:40:24.767848 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: > Sep 27 16:40:24.767848 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Instance ab77e6d5-1c27-420a-b7cd-b32c4f418dab could not be found. Sep 27 16:40:24.767848 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'id': 'ab77e6d5-1c27-420a-b7cd-b32c4f418dab'} Sep 27 16:40:24.768571 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:40:24.768571 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:40:24.768571 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:40:24.768571 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:40:24.768571 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:40:24.768571 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:40:24.768571 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:40:24.768571 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:40:24.768571 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:40:24.768571 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:40:24.768571 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab77e6d5-1c27-420a-b7cd-b32c4f418dab could not be found. Sep 27 16:40:24.768571 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:40:24.768571 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:40:24.768571 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:40:24.768571 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:40:24.768571 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:40:24.768571 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:40:24.768571 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:40:24.768571 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:40:24.768571 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:40:24.769692 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:40:24.769692 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:40:24.769692 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:40:24.769692 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:40:24.769692 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:40:24.769692 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:40:24.769692 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:40:24.769692 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab77e6d5-1c27-420a-b7cd-b32c4f418dab could not be found. Sep 27 16:40:24.769692 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:40:24.769692 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:40:24.769692 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:40:24.769692 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:40:24.769692 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:40:24.769692 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:40:24.769692 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:40:24.769692 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:40:24.769692 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab77e6d5-1c27-420a-b7cd-b32c4f418dab could not be found. Sep 27 16:40:24.769692 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:40:24.772358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bb52c53d-959b-483e-a343-aabd60d901c6 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Returning 404 to user: Instance ab77e6d5-1c27-420a-b7cd-b32c4f418dab could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:40:24.773341 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bb52c53d-959b-483e-a343-aabd60d901c6 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab" status: 404 len: 111 microversion: 2.1 time: 0.044303 Sep 27 16:40:24.774395 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 257/545] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:24 2022] GET /compute/v2.1/servers/ab77e6d5-1c27-420a-b7cd-b32c4f418dab => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:40:24.809799 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-f85d66b7-0b4d-443e-8cf1-70faae5a05e5 req-e1f86bc5-5c83-47ae-acdd-45a4a15bd72b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c68417-b41c-4ab3-9fac-9e7087bfe731", "tag": "3886c674-6e5a-4ef4-b25f-926b0453292c"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:40:24.820628 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-f85d66b7-0b4d-443e-8cf1-70faae5a05e5 req-e1f86bc5-5c83-47ae-acdd-45a4a15bd72b service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:24.821631 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-f85d66b7-0b4d-443e-8cf1-70faae5a05e5 req-e1f86bc5-5c83-47ae-acdd-45a4a15bd72b service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:24.821757 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-f85d66b7-0b4d-443e-8cf1-70faae5a05e5 req-e1f86bc5-5c83-47ae-acdd-45a4a15bd72b service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:24.834313 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-f85d66b7-0b4d-443e-8cf1-70faae5a05e5 req-e1f86bc5-5c83-47ae-acdd-45a4a15bd72b service nova] Creating event network-changed:3886c674-6e5a-4ef4-b25f-926b0453292c for instance 18c68417-b41c-4ab3-9fac-9e7087bfe731 on hv-cinder-85506 Sep 27 16:40:24.840065 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-f85d66b7-0b4d-443e-8cf1-70faae5a05e5 req-e1f86bc5-5c83-47ae-acdd-45a4a15bd72b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034182 Sep 27 16:40:24.840900 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 289/546] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:40:25.203974 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-373c0a3a-a8e0-45fa-8ea9-cecf9c4db024 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:25.205012 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-373c0a3a-a8e0-45fa-8ea9-cecf9c4db024 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:25.216452 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-373c0a3a-a8e0-45fa-8ea9-cecf9c4db024 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:25.217249 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-373c0a3a-a8e0-45fa-8ea9-cecf9c4db024 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:25.217838 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-373c0a3a-a8e0-45fa-8ea9-cecf9c4db024 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:25.219106 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-373c0a3a-a8e0-45fa-8ea9-cecf9c4db024 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:25.220031 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-373c0a3a-a8e0-45fa-8ea9-cecf9c4db024 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:25.220613 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-373c0a3a-a8e0-45fa-8ea9-cecf9c4db024 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:25.286636 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-373c0a3a-a8e0-45fa-8ea9-cecf9c4db024 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:25.287856 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-373c0a3a-a8e0-45fa-8ea9-cecf9c4db024 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:25.288449 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-373c0a3a-a8e0-45fa-8ea9-cecf9c4db024 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:25.289054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-373c0a3a-a8e0-45fa-8ea9-cecf9c4db024 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lazy-loading 'fault' on Instance uuid 8010c1e5-fe22-4255-a8df-0f63551bb226 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:40:25.344212 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-373c0a3a-a8e0-45fa-8ea9-cecf9c4db024 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:25.358815 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-373c0a3a-a8e0-45fa-8ea9-cecf9c4db024 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 200 len: 1331 microversion: 2.1 time: 0.158881 Sep 27 16:40:25.370863 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 258/547] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:25 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 1331 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:26.381780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-60680eb5-14be-4ec5-b01d-3a12908f2816 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:26.382482 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-60680eb5-14be-4ec5-b01d-3a12908f2816 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:26.388821 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-60680eb5-14be-4ec5-b01d-3a12908f2816 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:26.389669 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-60680eb5-14be-4ec5-b01d-3a12908f2816 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:26.389787 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-60680eb5-14be-4ec5-b01d-3a12908f2816 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:26.390436 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-60680eb5-14be-4ec5-b01d-3a12908f2816 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:26.390929 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-60680eb5-14be-4ec5-b01d-3a12908f2816 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:26.391357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-60680eb5-14be-4ec5-b01d-3a12908f2816 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:26.405455 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-60680eb5-14be-4ec5-b01d-3a12908f2816 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] HTTP exception thrown: Instance 8010c1e5-fe22-4255-a8df-0f63551bb226 could not be found. Sep 27 16:40:26.407163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-60680eb5-14be-4ec5-b01d-3a12908f2816 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Request method failure captured: Sep 27 16:40:26.407163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 HTTP/1.1 Sep 27 16:40:26.407163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:40:26.407163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:40:26.407163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:40:26.407163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:40:26.407163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:40:26.407163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:40:26.407163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:40:26.407163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:40:26.407163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMyaXt7kpD0PfNVvLYuBuVZ7HRidwt4V7Ad9Ym3_Vbex0YLxAbLBHGS-HGBld9NGzCqyRTvioGgsu3eg4VIjDtZIgTd01qZ6DSQMCZ0BknQO4xdhtqMgcyIwM-7CdV1bNe00wPntnIGZvSkxLDfg4QN7aDekfETC-lFwzlHlACFvCF14 Sep 27 16:40:26.407163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:40:26.407163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:40:26.407163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:40:26.407163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:40:26.407163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:40:26.407163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:40:26.407163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:40:26.407163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:40:26.407163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:40:26.407163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:40:26.408853 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_73fad530905b485cb7141793f6130a9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/73fad530905b485cb7141793f6130a9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:40:26.408853 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:40:26.408853 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:40:26.408853 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:40:26.408853 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:40:26.408853 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:40:26.408853 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:40:26.408853 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: e8d3af2b82b641aea11ebf79677a3af1 Sep 27 16:40:26.408853 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:40:26.408853 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:40:26.408853 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Instance 8010c1e5-fe22-4255-a8df-0f63551bb226 could not be found. Sep 27 16:40:26.408853 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': '8010c1e5-fe22-4255-a8df-0f63551bb226'} Sep 27 16:40:26.409565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:40:26.409565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:40:26.409565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:40:26.409565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:40:26.409565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:40:26.409565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:40:26.409565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:40:26.409565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:40:26.409565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:40:26.409565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:40:26.409565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8010c1e5-fe22-4255-a8df-0f63551bb226 could not be found. Sep 27 16:40:26.409565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:40:26.409565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:40:26.409565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:40:26.409565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:40:26.409565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:40:26.409565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:40:26.409565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:40:26.409565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:40:26.409565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:40:26.410683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:40:26.410683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:40:26.410683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:40:26.410683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:40:26.410683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:40:26.410683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:40:26.410683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:40:26.410683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8010c1e5-fe22-4255-a8df-0f63551bb226 could not be found. Sep 27 16:40:26.410683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:40:26.410683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:40:26.410683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:40:26.410683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:40:26.410683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:40:26.410683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:40:26.410683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:40:26.410683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:40:26.410683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8010c1e5-fe22-4255-a8df-0f63551bb226 could not be found. Sep 27 16:40:26.410683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:40:26.412455 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-60680eb5-14be-4ec5-b01d-3a12908f2816 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Returning 404 to user: Instance 8010c1e5-fe22-4255-a8df-0f63551bb226 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:40:26.412455 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-60680eb5-14be-4ec5-b01d-3a12908f2816 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 404 len: 111 microversion: 2.1 time: 0.031239 Sep 27 16:40:26.412455 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 290/548] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:26 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:40:26.419063 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fa4faa0e-b4b7-4b43-8f4f-a93ed5e99aef tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '.version_select at 0x7fa405a5b310>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:26.513417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fa4faa0e-b4b7-4b43-8f4f-a93ed5e99aef tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2051996152" status: 202 len: 0 microversion: 2.1 time: 0.099236 Sep 27 16:40:26.513998 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 259/549] 10.222.0.64 () {58 vars in 1221 bytes} [Tue Sep 27 16:40:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2051996152 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 16:40:27.160418 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-3ade19f2-7dc9-412a-b81b-02f5549b5395 req-3ff4facf-c84d-42c5-bc79-bd5987e1a25a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d959d05-2c44-4e4c-a8c0-9dd0b985b564", "tag": "52f691b3-ea75-4afe-9e42-e90c76a84965"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:40:27.169822 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-3ade19f2-7dc9-412a-b81b-02f5549b5395 req-3ff4facf-c84d-42c5-bc79-bd5987e1a25a service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:27.170296 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-3ade19f2-7dc9-412a-b81b-02f5549b5395 req-3ff4facf-c84d-42c5-bc79-bd5987e1a25a service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:27.170724 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-3ade19f2-7dc9-412a-b81b-02f5549b5395 req-3ff4facf-c84d-42c5-bc79-bd5987e1a25a service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:27.181994 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-3ade19f2-7dc9-412a-b81b-02f5549b5395 req-3ff4facf-c84d-42c5-bc79-bd5987e1a25a service nova] Creating event network-changed:52f691b3-ea75-4afe-9e42-e90c76a84965 for instance 3d959d05-2c44-4e4c-a8c0-9dd0b985b564 on hv-cinder-85506 Sep 27 16:40:27.187314 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-3ade19f2-7dc9-412a-b81b-02f5549b5395 req-3ff4facf-c84d-42c5-bc79-bd5987e1a25a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030705 Sep 27 16:40:27.190892 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 291/550] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:40:27.302403 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4736f72a-8ed1-48ed-80a7-c486e6fb3df6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Action: 'create', calling method: .version_select at 0x7fa40572e700>, body: {"keypair": {"name": "tempest-keypair-956496552", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHh6nAgmMufccZU5u88Olwfi2jijnHOxrZlNq1TAiOtLTODBEB6e4JUnlQfJ2lKrXfQrUAumddBSxEfLQoll2iKaFOucK5L9oTWCRJ5bLKM6aC7UK5uAz0p4fWI2mEpKQ=="}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:40:27.319248 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-4736f72a-8ed1-48ed-80a7-c486e6fb3df6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Getting quotas for project 73fad530905b485cb7141793f6130a9e. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:40:27.323235 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-4736f72a-8ed1-48ed-80a7-c486e6fb3df6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Getting quotas for user e8d3af2b82b641aea11ebf79677a3af1 and project 73fad530905b485cb7141793f6130a9e. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:40:27.392994 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4736f72a-8ed1-48ed-80a7-c486e6fb3df6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.094435 Sep 27 16:40:27.393594 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 260/551] 10.222.0.64 () {60 vars in 1159 bytes} [Tue Sep 27 16:40:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:40:29.772638 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f6a1d930-b594-409e-9872-52f85c575019 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2093945776", "imageRef": "6908a343-46fa-4801-bfb5-7ad92ac26956", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16983143-f1f9-476b-8846-75cee163a487"}], "security_groups": [{"name": "tempest-securitygroup--1240254742"}], "key_name": "tempest-keypair-956496552", "user_data": "}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:40:29.878340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-f6a1d930-b594-409e-9872-52f85c575019 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] validate_networks() for [('16983143-f1f9-476b-8846-75cee163a487', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 16:40:30.485859 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-f6a1d930-b594-409e-9872-52f85c575019 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 16:40:30.486289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-f6a1d930-b594-409e-9872-52f85c575019 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 16:40:30.486759 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-f6a1d930-b594-409e-9872-52f85c575019 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 16:40:30.487207 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-f6a1d930-b594-409e-9872-52f85c575019 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 16:40:30.487599 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-f6a1d930-b594-409e-9872-52f85c575019 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 16:40:30.498932 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6a1d930-b594-409e-9872-52f85c575019 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:30.499417 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6a1d930-b594-409e-9872-52f85c575019 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:30.499854 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6a1d930-b594-409e-9872-52f85c575019 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:30.503103 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6a1d930-b594-409e-9872-52f85c575019 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:30.503538 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6a1d930-b594-409e-9872-52f85c575019 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:30.503973 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f6a1d930-b594-409e-9872-52f85c575019 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:30.523187 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-f6a1d930-b594-409e-9872-52f85c575019 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Getting quotas for project 73fad530905b485cb7141793f6130a9e. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:40:30.527555 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-f6a1d930-b594-409e-9872-52f85c575019 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Getting quotas for user e8d3af2b82b641aea11ebf79677a3af1 and project 73fad530905b485cb7141793f6130a9e. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:40:30.541872 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f6a1d930-b594-409e-9872-52f85c575019 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 16:40:30.545228 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f6a1d930-b594-409e-9872-52f85c575019 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6908a343-46fa-4801-bfb5-7ad92ac26956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 16:40:30.669046 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f6a1d930-b594-409e-9872-52f85c575019 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.900951 Sep 27 16:40:30.669688 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 292/552] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Sep 27 16:40:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 16:40:30.682336 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0e028fe4-b43a-499c-b8c6-95e9c4137548 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:30.682979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0e028fe4-b43a-499c-b8c6-95e9c4137548 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:30.741314 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0e028fe4-b43a-499c-b8c6-95e9c4137548 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:30.749962 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0e028fe4-b43a-499c-b8c6-95e9c4137548 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 200 len: 1241 microversion: 2.1 time: 0.072757 Sep 27 16:40:30.750513 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 261/553] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:30 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:31.773114 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f72fd90b-8f71-4f04-aded-fc19557e44f4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:31.773746 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f72fd90b-8f71-4f04-aded-fc19557e44f4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:31.780655 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f72fd90b-8f71-4f04-aded-fc19557e44f4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:31.781134 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f72fd90b-8f71-4f04-aded-fc19557e44f4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:31.781565 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f72fd90b-8f71-4f04-aded-fc19557e44f4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:31.782246 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f72fd90b-8f71-4f04-aded-fc19557e44f4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:31.782695 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f72fd90b-8f71-4f04-aded-fc19557e44f4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:31.783406 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f72fd90b-8f71-4f04-aded-fc19557e44f4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:31.846259 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f72fd90b-8f71-4f04-aded-fc19557e44f4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:31.853764 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f72fd90b-8f71-4f04-aded-fc19557e44f4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 200 len: 1245 microversion: 2.1 time: 0.084762 Sep 27 16:40:31.854320 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 293/554] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:31 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:32.877632 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ee076560-a1de-4950-a536-aec074ddc26b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:32.878237 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ee076560-a1de-4950-a536-aec074ddc26b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:32.884980 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee076560-a1de-4950-a536-aec074ddc26b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:32.885456 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee076560-a1de-4950-a536-aec074ddc26b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:32.885885 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee076560-a1de-4950-a536-aec074ddc26b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:32.886564 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee076560-a1de-4950-a536-aec074ddc26b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:32.887042 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee076560-a1de-4950-a536-aec074ddc26b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:32.887489 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee076560-a1de-4950-a536-aec074ddc26b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:32.906165 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:32.950412 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ee076560-a1de-4950-a536-aec074ddc26b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:32.958302 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ee076560-a1de-4950-a536-aec074ddc26b tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 200 len: 1245 microversion: 2.1 time: 0.084651 Sep 27 16:40:32.958895 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 262/555] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:32 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:33.981366 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7d60efa8-09a3-4fbb-aa13-7c1b05f619c0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:33.982013 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7d60efa8-09a3-4fbb-aa13-7c1b05f619c0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:33.984492 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b1fa6f90-0584-4148-8193-ffc02a9d88f1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:40:33.986745 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b1fa6f90-0584-4148-8193-ffc02a9d88f1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:33.988093 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7d60efa8-09a3-4fbb-aa13-7c1b05f619c0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:33.988586 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7d60efa8-09a3-4fbb-aa13-7c1b05f619c0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:33.989031 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7d60efa8-09a3-4fbb-aa13-7c1b05f619c0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:33.989725 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7d60efa8-09a3-4fbb-aa13-7c1b05f619c0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:33.990186 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7d60efa8-09a3-4fbb-aa13-7c1b05f619c0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:33.990613 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7d60efa8-09a3-4fbb-aa13-7c1b05f619c0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:33.993559 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1fa6f90-0584-4148-8193-ffc02a9d88f1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:33.994041 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1fa6f90-0584-4148-8193-ffc02a9d88f1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:33.994474 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1fa6f90-0584-4148-8193-ffc02a9d88f1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:33.995192 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1fa6f90-0584-4148-8193-ffc02a9d88f1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:33.995653 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1fa6f90-0584-4148-8193-ffc02a9d88f1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:33.996080 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1fa6f90-0584-4148-8193-ffc02a9d88f1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:34.052137 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7d60efa8-09a3-4fbb-aa13-7c1b05f619c0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:34.062291 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7d60efa8-09a3-4fbb-aa13-7c1b05f619c0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 200 len: 1237 microversion: 2.1 time: 0.084889 Sep 27 16:40:34.062881 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 294/556] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:33 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:40:34.161370 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b1fa6f90-0584-4148-8193-ffc02a9d88f1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "POST /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7/action" status: 202 len: 0 microversion: 2.1 time: 0.181503 Sep 27 16:40:34.162350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 263/557] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Sep 27 16:40:33 2022] POST /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 16:40:34.171054 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f08c9b38-d962-447d-897e-6f0add082caa tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:34.171700 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f08c9b38-d962-447d-897e-6f0add082caa tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:34.177813 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f08c9b38-d962-447d-897e-6f0add082caa tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:34.178393 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f08c9b38-d962-447d-897e-6f0add082caa tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:34.180387 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f08c9b38-d962-447d-897e-6f0add082caa tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:34.180387 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f08c9b38-d962-447d-897e-6f0add082caa tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:34.180387 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f08c9b38-d962-447d-897e-6f0add082caa tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:34.180387 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f08c9b38-d962-447d-897e-6f0add082caa tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:34.337196 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f08c9b38-d962-447d-897e-6f0add082caa tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:34.354092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f08c9b38-d962-447d-897e-6f0add082caa tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1752 microversion: 2.1 time: 0.187474 Sep 27 16:40:34.354926 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 295/558] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:34 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1752 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:35.092933 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6f01cb6d-115c-4759-9a1a-5279dc10f0aa tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:35.094146 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6f01cb6d-115c-4759-9a1a-5279dc10f0aa tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:35.101886 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f01cb6d-115c-4759-9a1a-5279dc10f0aa tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:35.102362 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f01cb6d-115c-4759-9a1a-5279dc10f0aa tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:35.102818 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f01cb6d-115c-4759-9a1a-5279dc10f0aa tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:35.103495 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f01cb6d-115c-4759-9a1a-5279dc10f0aa tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:35.103944 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f01cb6d-115c-4759-9a1a-5279dc10f0aa tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:35.104399 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f01cb6d-115c-4759-9a1a-5279dc10f0aa tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:35.171731 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6f01cb6d-115c-4759-9a1a-5279dc10f0aa tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:35.179776 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6f01cb6d-115c-4759-9a1a-5279dc10f0aa tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 200 len: 1301 microversion: 2.1 time: 0.096613 Sep 27 16:40:35.180699 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 264/559] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:35 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 1301 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:35.362240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a0993c72-211e-449c-bf99-8cf113381db8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1232384948", "imageRef": "6908a343-46fa-4801-bfb5-7ad92ac26956", "flavorRef": "452", "networks": [{"uuid": "1d57f70d-1b9d-4c97-96ff-4182fbfe33f5"}]}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:40:35.377647 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-279b012d-ff35-4b69-a875-209d80bdd970 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:35.378284 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-279b012d-ff35-4b69-a875-209d80bdd970 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:35.387964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-279b012d-ff35-4b69-a875-209d80bdd970 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:35.387964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-279b012d-ff35-4b69-a875-209d80bdd970 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:35.387964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-279b012d-ff35-4b69-a875-209d80bdd970 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:35.387964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-279b012d-ff35-4b69-a875-209d80bdd970 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:35.388295 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-279b012d-ff35-4b69-a875-209d80bdd970 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:35.388384 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-279b012d-ff35-4b69-a875-209d80bdd970 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:35.419841 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-a0993c72-211e-449c-bf99-8cf113381db8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] validate_networks() for [('1d57f70d-1b9d-4c97-96ff-4182fbfe33f5', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 16:40:35.655483 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-279b012d-ff35-4b69-a875-209d80bdd970 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:35.669465 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-279b012d-ff35-4b69-a875-209d80bdd970 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1757 microversion: 2.1 time: 0.295531 Sep 27 16:40:35.682836 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 265/560] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:35 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1757 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:40:35.893113 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-a0993c72-211e-449c-bf99-8cf113381db8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 16:40:35.893537 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-a0993c72-211e-449c-bf99-8cf113381db8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 16:40:35.894042 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-a0993c72-211e-449c-bf99-8cf113381db8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 16:40:35.894465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-a0993c72-211e-449c-bf99-8cf113381db8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 16:40:35.897339 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-a0993c72-211e-449c-bf99-8cf113381db8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 16:40:35.903857 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0993c72-211e-449c-bf99-8cf113381db8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:35.904744 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0993c72-211e-449c-bf99-8cf113381db8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:35.905156 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0993c72-211e-449c-bf99-8cf113381db8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:35.905875 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0993c72-211e-449c-bf99-8cf113381db8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:35.906335 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0993c72-211e-449c-bf99-8cf113381db8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:35.906757 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0993c72-211e-449c-bf99-8cf113381db8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:35.924002 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-a0993c72-211e-449c-bf99-8cf113381db8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Getting quotas for project a06947e0733946bb8e266382c0d4d0ce. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:40:35.927731 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-a0993c72-211e-449c-bf99-8cf113381db8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Getting quotas for user 211efc6d124344c0b6ba83c378425df0 and project a06947e0733946bb8e266382c0d4d0ce. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:40:35.939467 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a0993c72-211e-449c-bf99-8cf113381db8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 16:40:35.941636 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a0993c72-211e-449c-bf99-8cf113381db8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6908a343-46fa-4801-bfb5-7ad92ac26956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 16:40:36.068412 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a0993c72-211e-449c-bf99-8cf113381db8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.710099 Sep 27 16:40:36.069193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 296/561] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Sep 27 16:40:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 16:40:36.080974 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ad51d4c9-fb6e-460c-8ea9-183ee4bca5db tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:36.081913 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ad51d4c9-fb6e-460c-8ea9-183ee4bca5db tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:36.180115 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ad51d4c9-fb6e-460c-8ea9-183ee4bca5db tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:36.190104 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ad51d4c9-fb6e-460c-8ea9-183ee4bca5db tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a" status: 200 len: 1219 microversion: 2.1 time: 0.112692 Sep 27 16:40:36.191304 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 266/562] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:36 2022] GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a => generated 1219 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:36.209810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e663b568-c27d-4d5a-a0e9-c00def49e14f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:36.210837 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e663b568-c27d-4d5a-a0e9-c00def49e14f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:36.224023 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e663b568-c27d-4d5a-a0e9-c00def49e14f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:36.224620 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e663b568-c27d-4d5a-a0e9-c00def49e14f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:36.225228 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e663b568-c27d-4d5a-a0e9-c00def49e14f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:36.226074 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e663b568-c27d-4d5a-a0e9-c00def49e14f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:36.233201 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e663b568-c27d-4d5a-a0e9-c00def49e14f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:36.233806 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e663b568-c27d-4d5a-a0e9-c00def49e14f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:36.395221 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e663b568-c27d-4d5a-a0e9-c00def49e14f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:36.404055 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e663b568-c27d-4d5a-a0e9-c00def49e14f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 200 len: 1367 microversion: 2.1 time: 0.199145 Sep 27 16:40:36.404634 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 297/563] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:36 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:36.697578 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2f82f6f0-c477-422f-b608-c1e4836a5ab6 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:36.698325 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2f82f6f0-c477-422f-b608-c1e4836a5ab6 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:36.705750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f82f6f0-c477-422f-b608-c1e4836a5ab6 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:36.706643 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f82f6f0-c477-422f-b608-c1e4836a5ab6 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:36.707375 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f82f6f0-c477-422f-b608-c1e4836a5ab6 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:36.708284 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f82f6f0-c477-422f-b608-c1e4836a5ab6 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:36.709070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f82f6f0-c477-422f-b608-c1e4836a5ab6 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:36.709814 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f82f6f0-c477-422f-b608-c1e4836a5ab6 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:36.878188 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2f82f6f0-c477-422f-b608-c1e4836a5ab6 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:36.886650 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2f82f6f0-c477-422f-b608-c1e4836a5ab6 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1757 microversion: 2.1 time: 0.195166 Sep 27 16:40:36.887333 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 267/564] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:36 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:37.212749 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f1b04323-cbd2-4f52-8e33-19c73930a956 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:37.213363 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f1b04323-cbd2-4f52-8e33-19c73930a956 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:37.220007 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1b04323-cbd2-4f52-8e33-19c73930a956 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:37.220496 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1b04323-cbd2-4f52-8e33-19c73930a956 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:37.220938 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1b04323-cbd2-4f52-8e33-19c73930a956 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:37.221640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1b04323-cbd2-4f52-8e33-19c73930a956 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:37.222096 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1b04323-cbd2-4f52-8e33-19c73930a956 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:37.222520 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1b04323-cbd2-4f52-8e33-19c73930a956 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:37.277381 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-afaccc19-581b-4adf-83a9-bafa665d9248 req-de677647-e814-42d9-93f1-6b346c9cf567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e036d20a-962b-4196-8b51-1edc199c9700", "tag": "9a15757f-ac3b-4ddc-80eb-dac8224d7ea4"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:40:37.289618 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f1b04323-cbd2-4f52-8e33-19c73930a956 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:37.292118 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-afaccc19-581b-4adf-83a9-bafa665d9248 req-de677647-e814-42d9-93f1-6b346c9cf567 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:37.292607 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-afaccc19-581b-4adf-83a9-bafa665d9248 req-de677647-e814-42d9-93f1-6b346c9cf567 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:37.293038 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-afaccc19-581b-4adf-83a9-bafa665d9248 req-de677647-e814-42d9-93f1-6b346c9cf567 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:37.298703 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f1b04323-cbd2-4f52-8e33-19c73930a956 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a" status: 200 len: 1223 microversion: 2.1 time: 0.089930 Sep 27 16:40:37.299646 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 298/565] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:37 2022] GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:37.307739 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-afaccc19-581b-4adf-83a9-bafa665d9248 req-de677647-e814-42d9-93f1-6b346c9cf567 service nova] Creating event network-changed:9a15757f-ac3b-4ddc-80eb-dac8224d7ea4 for instance e036d20a-962b-4196-8b51-1edc199c9700 on hv-cinder-85506 Sep 27 16:40:37.317843 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-afaccc19-581b-4adf-83a9-bafa665d9248 req-de677647-e814-42d9-93f1-6b346c9cf567 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045390 Sep 27 16:40:37.322152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 268/566] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:40:37.427962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6c5e49bc-8edb-44df-9d2e-89c617de2f7d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:37.431120 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6c5e49bc-8edb-44df-9d2e-89c617de2f7d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:37.435397 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c5e49bc-8edb-44df-9d2e-89c617de2f7d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:37.435899 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c5e49bc-8edb-44df-9d2e-89c617de2f7d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:37.436339 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c5e49bc-8edb-44df-9d2e-89c617de2f7d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:37.437121 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c5e49bc-8edb-44df-9d2e-89c617de2f7d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:37.437587 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c5e49bc-8edb-44df-9d2e-89c617de2f7d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:37.438015 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c5e49bc-8edb-44df-9d2e-89c617de2f7d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:37.600428 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6c5e49bc-8edb-44df-9d2e-89c617de2f7d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:37.608945 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6c5e49bc-8edb-44df-9d2e-89c617de2f7d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 200 len: 1367 microversion: 2.1 time: 0.185290 Sep 27 16:40:37.609610 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 299/567] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:37 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:37.910233 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d739719a-2b24-4a2e-9be9-972202fa50d9 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:37.910951 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d739719a-2b24-4a2e-9be9-972202fa50d9 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:37.917089 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d739719a-2b24-4a2e-9be9-972202fa50d9 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:37.917508 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d739719a-2b24-4a2e-9be9-972202fa50d9 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:37.917939 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d739719a-2b24-4a2e-9be9-972202fa50d9 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:37.918757 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d739719a-2b24-4a2e-9be9-972202fa50d9 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:37.919248 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d739719a-2b24-4a2e-9be9-972202fa50d9 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:37.919664 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d739719a-2b24-4a2e-9be9-972202fa50d9 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:38.069594 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d739719a-2b24-4a2e-9be9-972202fa50d9 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:38.078442 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d739719a-2b24-4a2e-9be9-972202fa50d9 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1757 microversion: 2.1 time: 0.172696 Sep 27 16:40:38.079043 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 269/568] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:37 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:38.322670 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ca416460-045d-4e72-8200-0af89eedf0fd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:38.323583 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ca416460-045d-4e72-8200-0af89eedf0fd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:38.331021 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ca416460-045d-4e72-8200-0af89eedf0fd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:38.332830 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ca416460-045d-4e72-8200-0af89eedf0fd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:38.333874 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ca416460-045d-4e72-8200-0af89eedf0fd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:38.335230 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ca416460-045d-4e72-8200-0af89eedf0fd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:38.335915 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ca416460-045d-4e72-8200-0af89eedf0fd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:38.342880 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ca416460-045d-4e72-8200-0af89eedf0fd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:38.407182 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ca416460-045d-4e72-8200-0af89eedf0fd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:38.415838 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ca416460-045d-4e72-8200-0af89eedf0fd tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a" status: 200 len: 1271 microversion: 2.1 time: 0.097437 Sep 27 16:40:38.416408 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 300/569] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:38 2022] GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:38.632555 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-60ea9332-1f68-42ca-9c2e-872fca0daa4d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:38.633299 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-60ea9332-1f68-42ca-9c2e-872fca0daa4d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:38.640729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60ea9332-1f68-42ca-9c2e-872fca0daa4d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:38.641217 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60ea9332-1f68-42ca-9c2e-872fca0daa4d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:38.641655 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60ea9332-1f68-42ca-9c2e-872fca0daa4d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:38.642349 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60ea9332-1f68-42ca-9c2e-872fca0daa4d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:38.642829 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60ea9332-1f68-42ca-9c2e-872fca0daa4d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:38.643258 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60ea9332-1f68-42ca-9c2e-872fca0daa4d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:38.772785 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-60ea9332-1f68-42ca-9c2e-872fca0daa4d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:38.780800 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-60ea9332-1f68-42ca-9c2e-872fca0daa4d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 200 len: 1367 microversion: 2.1 time: 0.152138 Sep 27 16:40:38.781370 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 270/570] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:38 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:39.104872 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9d007bc5-1a9f-411c-85c5-1cc32c2dd5db tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:39.105498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9d007bc5-1a9f-411c-85c5-1cc32c2dd5db tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:39.112619 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d007bc5-1a9f-411c-85c5-1cc32c2dd5db tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:39.113158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d007bc5-1a9f-411c-85c5-1cc32c2dd5db tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:39.113594 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d007bc5-1a9f-411c-85c5-1cc32c2dd5db tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:39.114287 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d007bc5-1a9f-411c-85c5-1cc32c2dd5db tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:39.114744 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d007bc5-1a9f-411c-85c5-1cc32c2dd5db tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:39.115188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d007bc5-1a9f-411c-85c5-1cc32c2dd5db tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:39.259181 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9d007bc5-1a9f-411c-85c5-1cc32c2dd5db tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:39.267938 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9d007bc5-1a9f-411c-85c5-1cc32c2dd5db tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1757 microversion: 2.1 time: 0.169893 Sep 27 16:40:39.268500 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 301/571] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:39 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:39.440030 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b4ef812b-3584-4289-86e0-f7b90e2fe81c tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:39.440714 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b4ef812b-3584-4289-86e0-f7b90e2fe81c tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:39.446748 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4ef812b-3584-4289-86e0-f7b90e2fe81c tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:39.447393 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4ef812b-3584-4289-86e0-f7b90e2fe81c tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:39.447953 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4ef812b-3584-4289-86e0-f7b90e2fe81c tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:39.448770 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4ef812b-3584-4289-86e0-f7b90e2fe81c tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:39.449320 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4ef812b-3584-4289-86e0-f7b90e2fe81c tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:39.450456 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4ef812b-3584-4289-86e0-f7b90e2fe81c tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:39.510935 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b4ef812b-3584-4289-86e0-f7b90e2fe81c tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:39.519212 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b4ef812b-3584-4289-86e0-f7b90e2fe81c tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a" status: 200 len: 1271 microversion: 2.1 time: 0.083105 Sep 27 16:40:39.519786 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 271/572] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:39 2022] GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:39.804074 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4ef69a10-0274-4b5a-9abd-0d3b4e82d507 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:39.804681 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4ef69a10-0274-4b5a-9abd-0d3b4e82d507 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:39.811102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ef69a10-0274-4b5a-9abd-0d3b4e82d507 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:39.811743 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ef69a10-0274-4b5a-9abd-0d3b4e82d507 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:39.812173 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ef69a10-0274-4b5a-9abd-0d3b4e82d507 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:39.812856 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ef69a10-0274-4b5a-9abd-0d3b4e82d507 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:39.813308 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ef69a10-0274-4b5a-9abd-0d3b4e82d507 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:39.813725 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ef69a10-0274-4b5a-9abd-0d3b4e82d507 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:39.945339 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4ef69a10-0274-4b5a-9abd-0d3b4e82d507 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:39.953730 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4ef69a10-0274-4b5a-9abd-0d3b4e82d507 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 200 len: 1367 microversion: 2.1 time: 0.153568 Sep 27 16:40:39.954298 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 302/573] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:39 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:40.292194 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-317f2287-d055-4cd2-8c0a-5c1c27647d8a tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:40.292814 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-317f2287-d055-4cd2-8c0a-5c1c27647d8a tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:40.299558 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-317f2287-d055-4cd2-8c0a-5c1c27647d8a tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:40.300043 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-317f2287-d055-4cd2-8c0a-5c1c27647d8a tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:40.300471 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-317f2287-d055-4cd2-8c0a-5c1c27647d8a tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:40.301166 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-317f2287-d055-4cd2-8c0a-5c1c27647d8a tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:40.301614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-317f2287-d055-4cd2-8c0a-5c1c27647d8a tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:40.302033 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-317f2287-d055-4cd2-8c0a-5c1c27647d8a tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:40.456207 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-317f2287-d055-4cd2-8c0a-5c1c27647d8a tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:40.464378 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-317f2287-d055-4cd2-8c0a-5c1c27647d8a tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1757 microversion: 2.1 time: 0.176133 Sep 27 16:40:40.464978 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 272/574] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:40 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:40.541584 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-32c5de70-465a-467d-a604-3d165c6587e1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:40.542350 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-32c5de70-465a-467d-a604-3d165c6587e1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:40.549096 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32c5de70-465a-467d-a604-3d165c6587e1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:40.549664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32c5de70-465a-467d-a604-3d165c6587e1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:40.550207 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32c5de70-465a-467d-a604-3d165c6587e1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:40.550945 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32c5de70-465a-467d-a604-3d165c6587e1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:40.551585 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32c5de70-465a-467d-a604-3d165c6587e1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:40.552029 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32c5de70-465a-467d-a604-3d165c6587e1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:40.616023 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-32c5de70-465a-467d-a604-3d165c6587e1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:40.624693 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-32c5de70-465a-467d-a604-3d165c6587e1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a" status: 200 len: 1277 microversion: 2.1 time: 0.087098 Sep 27 16:40:40.625404 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 303/575] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:40 2022] GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:40.977565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6b16aaad-4387-4cb1-bdd3-6aeeea239943 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:40.980412 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6b16aaad-4387-4cb1-bdd3-6aeeea239943 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:40.984490 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6b16aaad-4387-4cb1-bdd3-6aeeea239943 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:40.984972 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6b16aaad-4387-4cb1-bdd3-6aeeea239943 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:40.985398 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6b16aaad-4387-4cb1-bdd3-6aeeea239943 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:40.986083 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6b16aaad-4387-4cb1-bdd3-6aeeea239943 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:40.986532 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6b16aaad-4387-4cb1-bdd3-6aeeea239943 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:40.986975 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6b16aaad-4387-4cb1-bdd3-6aeeea239943 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:41.126566 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6b16aaad-4387-4cb1-bdd3-6aeeea239943 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:41.135765 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6b16aaad-4387-4cb1-bdd3-6aeeea239943 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 200 len: 1367 microversion: 2.1 time: 0.162118 Sep 27 16:40:41.136328 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 273/576] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:40 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:41.489585 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-35262dfe-92e7-4274-9c5a-9eb2f46f03d4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:41.490333 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-35262dfe-92e7-4274-9c5a-9eb2f46f03d4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:41.496997 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35262dfe-92e7-4274-9c5a-9eb2f46f03d4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:41.497745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35262dfe-92e7-4274-9c5a-9eb2f46f03d4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:41.498283 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35262dfe-92e7-4274-9c5a-9eb2f46f03d4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:41.499021 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35262dfe-92e7-4274-9c5a-9eb2f46f03d4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:41.499472 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35262dfe-92e7-4274-9c5a-9eb2f46f03d4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:41.499896 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-35262dfe-92e7-4274-9c5a-9eb2f46f03d4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:41.519525 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:41.648669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-90201f35-d459-4ae6-9404-b2f633cc9c50 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:41.649277 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-90201f35-d459-4ae6-9404-b2f633cc9c50 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:41.650973 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-35262dfe-92e7-4274-9c5a-9eb2f46f03d4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:41.655861 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90201f35-d459-4ae6-9404-b2f633cc9c50 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:41.656342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90201f35-d459-4ae6-9404-b2f633cc9c50 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:41.656765 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90201f35-d459-4ae6-9404-b2f633cc9c50 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:41.657455 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90201f35-d459-4ae6-9404-b2f633cc9c50 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:41.658155 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90201f35-d459-4ae6-9404-b2f633cc9c50 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:41.658568 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90201f35-d459-4ae6-9404-b2f633cc9c50 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:41.661984 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-35262dfe-92e7-4274-9c5a-9eb2f46f03d4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1757 microversion: 2.1 time: 0.176331 Sep 27 16:40:41.666743 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 304/577] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:41 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:41.793991 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-90201f35-d459-4ae6-9404-b2f633cc9c50 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:41.802201 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-90201f35-d459-4ae6-9404-b2f633cc9c50 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a" status: 200 len: 1319 microversion: 2.1 time: 0.157436 Sep 27 16:40:41.818094 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 274/578] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:41 2022] GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:40:41.998323 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-90c33db4-8849-4516-ab60-b45d87eff71e req-f68c5563-4a46-4087-9ff1-1241289b911a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "917a245d-3957-45a3-a011-67b79c56ea0a", "tag": "22b2a016-09d8-4486-8dd8-f824c8714bbe"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:40:42.007714 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-90c33db4-8849-4516-ab60-b45d87eff71e req-f68c5563-4a46-4087-9ff1-1241289b911a service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:42.008197 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-90c33db4-8849-4516-ab60-b45d87eff71e req-f68c5563-4a46-4087-9ff1-1241289b911a service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:42.008629 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-90c33db4-8849-4516-ab60-b45d87eff71e req-f68c5563-4a46-4087-9ff1-1241289b911a service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:42.019834 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-90c33db4-8849-4516-ab60-b45d87eff71e req-f68c5563-4a46-4087-9ff1-1241289b911a service nova] Creating event network-changed:22b2a016-09d8-4486-8dd8-f824c8714bbe for instance 917a245d-3957-45a3-a011-67b79c56ea0a on hv-cinder-85506 Sep 27 16:40:42.024831 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-90c33db4-8849-4516-ab60-b45d87eff71e req-f68c5563-4a46-4087-9ff1-1241289b911a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030821 Sep 27 16:40:42.025421 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 305/579] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:40:42.160832 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5e3c5352-1252-4857-b7fe-e171d921f6ef tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:42.161439 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5e3c5352-1252-4857-b7fe-e171d921f6ef tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:42.167810 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e3c5352-1252-4857-b7fe-e171d921f6ef tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:42.168825 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e3c5352-1252-4857-b7fe-e171d921f6ef tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:42.169258 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e3c5352-1252-4857-b7fe-e171d921f6ef tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:42.169960 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e3c5352-1252-4857-b7fe-e171d921f6ef tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:42.170414 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e3c5352-1252-4857-b7fe-e171d921f6ef tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:42.170869 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e3c5352-1252-4857-b7fe-e171d921f6ef tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:42.303743 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5e3c5352-1252-4857-b7fe-e171d921f6ef tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:42.311843 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5e3c5352-1252-4857-b7fe-e171d921f6ef tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 200 len: 1367 microversion: 2.1 time: 0.155042 Sep 27 16:40:42.312424 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 275/580] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:42 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:42.687318 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bb7c4ec7-6949-4aa2-b725-2fef0026ee15 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:42.688019 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bb7c4ec7-6949-4aa2-b725-2fef0026ee15 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:42.694683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb7c4ec7-6949-4aa2-b725-2fef0026ee15 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:42.695292 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb7c4ec7-6949-4aa2-b725-2fef0026ee15 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:42.695956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb7c4ec7-6949-4aa2-b725-2fef0026ee15 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:42.696662 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb7c4ec7-6949-4aa2-b725-2fef0026ee15 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:42.697122 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb7c4ec7-6949-4aa2-b725-2fef0026ee15 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:42.697539 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb7c4ec7-6949-4aa2-b725-2fef0026ee15 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:42.829392 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a3f81267-d87f-4655-a3a3-591aa97887f8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:42.830013 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a3f81267-d87f-4655-a3a3-591aa97887f8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:42.836160 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3f81267-d87f-4655-a3a3-591aa97887f8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:42.836640 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3f81267-d87f-4655-a3a3-591aa97887f8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:42.837074 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3f81267-d87f-4655-a3a3-591aa97887f8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:42.837774 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3f81267-d87f-4655-a3a3-591aa97887f8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:42.838228 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3f81267-d87f-4655-a3a3-591aa97887f8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:42.838653 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3f81267-d87f-4655-a3a3-591aa97887f8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:42.846897 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bb7c4ec7-6949-4aa2-b725-2fef0026ee15 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:42.856026 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bb7c4ec7-6949-4aa2-b725-2fef0026ee15 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1757 microversion: 2.1 time: 0.173115 Sep 27 16:40:42.856616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 306/581] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:42 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:42.971881 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a3f81267-d87f-4655-a3a3-591aa97887f8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:42.979429 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a3f81267-d87f-4655-a3a3-591aa97887f8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a" status: 200 len: 1319 microversion: 2.1 time: 0.154757 Sep 27 16:40:42.979989 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 276/582] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:42 2022] GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:40:43.335536 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f5794221-59a6-4c4a-9d36-77cfb20683f6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:43.336145 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f5794221-59a6-4c4a-9d36-77cfb20683f6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:43.342274 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5794221-59a6-4c4a-9d36-77cfb20683f6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:43.342761 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5794221-59a6-4c4a-9d36-77cfb20683f6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:43.343231 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5794221-59a6-4c4a-9d36-77cfb20683f6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:43.343947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5794221-59a6-4c4a-9d36-77cfb20683f6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:43.344388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5794221-59a6-4c4a-9d36-77cfb20683f6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:43.344845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5794221-59a6-4c4a-9d36-77cfb20683f6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:43.470417 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f5794221-59a6-4c4a-9d36-77cfb20683f6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:43.478081 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f5794221-59a6-4c4a-9d36-77cfb20683f6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 200 len: 1367 microversion: 2.1 time: 0.146288 Sep 27 16:40:43.478644 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 307/583] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:43 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:43.879455 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5ed90658-e9a5-4033-9d5d-270b06ff932d tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:43.880070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5ed90658-e9a5-4033-9d5d-270b06ff932d tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:43.886463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ed90658-e9a5-4033-9d5d-270b06ff932d tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:43.887024 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ed90658-e9a5-4033-9d5d-270b06ff932d tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:43.887445 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ed90658-e9a5-4033-9d5d-270b06ff932d tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:43.888138 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ed90658-e9a5-4033-9d5d-270b06ff932d tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:43.888600 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ed90658-e9a5-4033-9d5d-270b06ff932d tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:43.889023 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5ed90658-e9a5-4033-9d5d-270b06ff932d tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:44.002555 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3f7a652f-8793-444c-981f-f3466d79c36d tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:44.003192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3f7a652f-8793-444c-981f-f3466d79c36d tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:44.008974 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f7a652f-8793-444c-981f-f3466d79c36d tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:44.009462 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f7a652f-8793-444c-981f-f3466d79c36d tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:44.009895 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f7a652f-8793-444c-981f-f3466d79c36d tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:44.010608 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f7a652f-8793-444c-981f-f3466d79c36d tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:44.011072 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f7a652f-8793-444c-981f-f3466d79c36d tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:44.011501 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f7a652f-8793-444c-981f-f3466d79c36d tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:44.031738 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5ed90658-e9a5-4033-9d5d-270b06ff932d tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:44.040238 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5ed90658-e9a5-4033-9d5d-270b06ff932d tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1757 microversion: 2.1 time: 0.164621 Sep 27 16:40:44.040807 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 277/584] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:43 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:44.158706 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3f7a652f-8793-444c-981f-f3466d79c36d tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:44.166383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3f7a652f-8793-444c-981f-f3466d79c36d tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a" status: 200 len: 1319 microversion: 2.1 time: 0.167740 Sep 27 16:40:44.166968 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 308/585] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:43 2022] GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:40:44.502141 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1b0ad40f-6a2d-4ea0-a5dc-5360c8a30e60 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:44.502755 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1b0ad40f-6a2d-4ea0-a5dc-5360c8a30e60 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:44.508778 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b0ad40f-6a2d-4ea0-a5dc-5360c8a30e60 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:44.509264 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b0ad40f-6a2d-4ea0-a5dc-5360c8a30e60 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:44.509697 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b0ad40f-6a2d-4ea0-a5dc-5360c8a30e60 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:44.510393 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b0ad40f-6a2d-4ea0-a5dc-5360c8a30e60 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:44.510872 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b0ad40f-6a2d-4ea0-a5dc-5360c8a30e60 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:44.511298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b0ad40f-6a2d-4ea0-a5dc-5360c8a30e60 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:44.615174 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-09dbe6bc-16cf-4507-88ed-1ff05d3cf40b req-1b0e3c14-f508-4507-b6f1-c53c1628a678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e036d20a-962b-4196-8b51-1edc199c9700", "name": "network-vif-plugged", "status": "completed", "tag": "9a15757f-ac3b-4ddc-80eb-dac8224d7ea4"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:40:44.625162 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-09dbe6bc-16cf-4507-88ed-1ff05d3cf40b req-1b0e3c14-f508-4507-b6f1-c53c1628a678 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:44.625735 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-09dbe6bc-16cf-4507-88ed-1ff05d3cf40b req-1b0e3c14-f508-4507-b6f1-c53c1628a678 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:44.626168 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-09dbe6bc-16cf-4507-88ed-1ff05d3cf40b req-1b0e3c14-f508-4507-b6f1-c53c1628a678 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:44.637426 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-09dbe6bc-16cf-4507-88ed-1ff05d3cf40b req-1b0e3c14-f508-4507-b6f1-c53c1628a678 service nova] Creating event network-vif-plugged:9a15757f-ac3b-4ddc-80eb-dac8224d7ea4 for instance e036d20a-962b-4196-8b51-1edc199c9700 on hv-cinder-85506 Sep 27 16:40:44.642235 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-09dbe6bc-16cf-4507-88ed-1ff05d3cf40b req-1b0e3c14-f508-4507-b6f1-c53c1628a678 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030833 Sep 27 16:40:44.642863 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 309/586] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:40:44.645090 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1b0ad40f-6a2d-4ea0-a5dc-5360c8a30e60 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:44.654170 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1b0ad40f-6a2d-4ea0-a5dc-5360c8a30e60 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 200 len: 1367 microversion: 2.1 time: 0.155419 Sep 27 16:40:44.655353 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 278/587] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:44 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:45.036923 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c708ed32-e431-47be-ac40-7b6916e10b70 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:45.037469 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c708ed32-e431-47be-ac40-7b6916e10b70 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:45.043777 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c708ed32-e431-47be-ac40-7b6916e10b70 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:45.044268 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c708ed32-e431-47be-ac40-7b6916e10b70 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:45.044896 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c708ed32-e431-47be-ac40-7b6916e10b70 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:45.045603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c708ed32-e431-47be-ac40-7b6916e10b70 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:45.046063 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c708ed32-e431-47be-ac40-7b6916e10b70 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:45.046494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c708ed32-e431-47be-ac40-7b6916e10b70 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:45.065947 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-25ed44d9-ec9f-48cb-b0a8-f7102ea9e3cc tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:45.068545 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-25ed44d9-ec9f-48cb-b0a8-f7102ea9e3cc tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:45.074794 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-25ed44d9-ec9f-48cb-b0a8-f7102ea9e3cc tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:45.075971 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-25ed44d9-ec9f-48cb-b0a8-f7102ea9e3cc tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:45.076418 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-25ed44d9-ec9f-48cb-b0a8-f7102ea9e3cc tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:45.077133 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-25ed44d9-ec9f-48cb-b0a8-f7102ea9e3cc tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:45.077595 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-25ed44d9-ec9f-48cb-b0a8-f7102ea9e3cc tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:45.077707 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c708ed32-e431-47be-ac40-7b6916e10b70 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9/os-volume_attachments/ec273422-5303-4c7b-8048-66c6d34f55b7" status: 200 len: 194 microversion: 2.20 time: 0.045454 Sep 27 16:40:45.078013 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-25ed44d9-ec9f-48cb-b0a8-f7102ea9e3cc tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:45.078266 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 310/588] 10.222.0.64 () {60 vars in 1454 bytes} [Tue Sep 27 16:40:45 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9/os-volume_attachments/ec273422-5303-4c7b-8048-66c6d34f55b7 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 16:40:45.148440 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5cc811ba-a97a-46a1-bf4f-a290ef76a950 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:45.148943 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5cc811ba-a97a-46a1-bf4f-a290ef76a950 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:45.155657 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5cc811ba-a97a-46a1-bf4f-a290ef76a950 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:45.156151 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5cc811ba-a97a-46a1-bf4f-a290ef76a950 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:45.156595 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5cc811ba-a97a-46a1-bf4f-a290ef76a950 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:45.157296 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5cc811ba-a97a-46a1-bf4f-a290ef76a950 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:45.158019 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5cc811ba-a97a-46a1-bf4f-a290ef76a950 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:45.158442 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5cc811ba-a97a-46a1-bf4f-a290ef76a950 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:45.227954 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-25ed44d9-ec9f-48cb-b0a8-f7102ea9e3cc tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:45.231640 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:45.237086 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-25ed44d9-ec9f-48cb-b0a8-f7102ea9e3cc tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1757 microversion: 2.1 time: 0.176067 Sep 27 16:40:45.237657 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 279/589] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:45 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:40:45.240471 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-5cc811ba-a97a-46a1-bf4f-a290ef76a950 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lazy-loading 'services' on Instance uuid f84acf37-9445-48cd-a921-12a7a3c301d9 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:40:45.259019 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6fbcb032-8a32-42d6-bdcb-270b5f9e05cb tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:45.259019 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6fbcb032-8a32-42d6-bdcb-270b5f9e05cb tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:45.259019 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fbcb032-8a32-42d6-bdcb-270b5f9e05cb tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:45.259019 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fbcb032-8a32-42d6-bdcb-270b5f9e05cb tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:45.259419 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fbcb032-8a32-42d6-bdcb-270b5f9e05cb tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:45.259419 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fbcb032-8a32-42d6-bdcb-270b5f9e05cb tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:45.259419 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fbcb032-8a32-42d6-bdcb-270b5f9e05cb tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:45.259419 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fbcb032-8a32-42d6-bdcb-270b5f9e05cb tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:45.383927 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6fbcb032-8a32-42d6-bdcb-270b5f9e05cb tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:45.392080 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6fbcb032-8a32-42d6-bdcb-270b5f9e05cb tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a" status: 200 len: 1319 microversion: 2.1 time: 0.153489 Sep 27 16:40:45.398426 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 280/590] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:45 2022] GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:45.419131 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5cc811ba-a97a-46a1-bf4f-a290ef76a950 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9/os-volume_attachments/ec273422-5303-4c7b-8048-66c6d34f55b7" status: 202 len: 0 microversion: 2.20 time: 0.274421 Sep 27 16:40:45.419715 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 311/591] 10.222.0.64 () {60 vars in 1457 bytes} [Tue Sep 27 16:40:45 2022] DELETE /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9/os-volume_attachments/ec273422-5303-4c7b-8048-66c6d34f55b7 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 27 16:40:45.431248 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b94fa282-f591-4bff-82b3-8b016093ba00 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:45.433493 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b94fa282-f591-4bff-82b3-8b016093ba00 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:45.440485 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b94fa282-f591-4bff-82b3-8b016093ba00 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:45.440962 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b94fa282-f591-4bff-82b3-8b016093ba00 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:45.441385 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b94fa282-f591-4bff-82b3-8b016093ba00 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:45.442073 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b94fa282-f591-4bff-82b3-8b016093ba00 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:45.442518 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b94fa282-f591-4bff-82b3-8b016093ba00 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:45.442968 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b94fa282-f591-4bff-82b3-8b016093ba00 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:45.472685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b94fa282-f591-4bff-82b3-8b016093ba00 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045682 Sep 27 16:40:45.473234 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 281/592] 10.222.0.64 () {60 vars in 1343 bytes} [Tue Sep 27 16:40:45 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 16:40:45.679690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2d04ab11-e95b-4a95-88f3-a5fcf902abd1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:45.680388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2d04ab11-e95b-4a95-88f3-a5fcf902abd1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:45.682308 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:45.687793 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d04ab11-e95b-4a95-88f3-a5fcf902abd1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:45.688276 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d04ab11-e95b-4a95-88f3-a5fcf902abd1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:45.688707 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d04ab11-e95b-4a95-88f3-a5fcf902abd1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:45.689392 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d04ab11-e95b-4a95-88f3-a5fcf902abd1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:45.689840 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d04ab11-e95b-4a95-88f3-a5fcf902abd1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:45.690262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2d04ab11-e95b-4a95-88f3-a5fcf902abd1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:45.822451 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2d04ab11-e95b-4a95-88f3-a5fcf902abd1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:45.830533 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2d04ab11-e95b-4a95-88f3-a5fcf902abd1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 200 len: 1367 microversion: 2.1 time: 0.155032 Sep 27 16:40:45.831122 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 312/593] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:45 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:46.271523 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-43c8b6a3-92da-4682-bdf6-9f61058281f4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:46.272136 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-43c8b6a3-92da-4682-bdf6-9f61058281f4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:46.274446 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=8 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:46.279735 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43c8b6a3-92da-4682-bdf6-9f61058281f4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:46.291435 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43c8b6a3-92da-4682-bdf6-9f61058281f4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:46.291435 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43c8b6a3-92da-4682-bdf6-9f61058281f4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:46.291435 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43c8b6a3-92da-4682-bdf6-9f61058281f4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:46.291435 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43c8b6a3-92da-4682-bdf6-9f61058281f4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:46.291810 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43c8b6a3-92da-4682-bdf6-9f61058281f4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:46.415735 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3372f165-fdf7-4800-b7cd-8c20ef2c524c tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:46.416354 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3372f165-fdf7-4800-b7cd-8c20ef2c524c tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:46.419857 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=4 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:46.420713 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=12 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:46.424258 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3372f165-fdf7-4800-b7cd-8c20ef2c524c tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:46.424720 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3372f165-fdf7-4800-b7cd-8c20ef2c524c tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:46.425161 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3372f165-fdf7-4800-b7cd-8c20ef2c524c tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:46.425860 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3372f165-fdf7-4800-b7cd-8c20ef2c524c tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:46.426314 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3372f165-fdf7-4800-b7cd-8c20ef2c524c tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:46.426735 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3372f165-fdf7-4800-b7cd-8c20ef2c524c tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:46.434658 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-43c8b6a3-92da-4682-bdf6-9f61058281f4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:46.440243 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-43c8b6a3-92da-4682-bdf6-9f61058281f4 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1757 microversion: 2.1 time: 0.172513 Sep 27 16:40:46.441145 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 282/594] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:46 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:46.486429 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-01bc8402-fad9-485d-a000-cbe198caf32e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:46.488945 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-01bc8402-fad9-485d-a000-cbe198caf32e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:46.494788 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-01bc8402-fad9-485d-a000-cbe198caf32e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:46.495294 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-01bc8402-fad9-485d-a000-cbe198caf32e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:46.495765 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-01bc8402-fad9-485d-a000-cbe198caf32e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:46.496794 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-01bc8402-fad9-485d-a000-cbe198caf32e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:46.497420 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-01bc8402-fad9-485d-a000-cbe198caf32e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:46.497858 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-01bc8402-fad9-485d-a000-cbe198caf32e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:46.534036 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-01bc8402-fad9-485d-a000-cbe198caf32e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051767 Sep 27 16:40:46.535291 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 283/595] 10.222.0.64 () {60 vars in 1343 bytes} [Tue Sep 27 16:40:46 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 16:40:46.588174 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3372f165-fdf7-4800-b7cd-8c20ef2c524c tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:46.596746 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3372f165-fdf7-4800-b7cd-8c20ef2c524c tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a" status: 200 len: 1319 microversion: 2.1 time: 0.184769 Sep 27 16:40:46.611019 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 313/596] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:46 2022] GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:40:46.853676 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3f1da767-db37-4663-89a6-40986a5d8935 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:46.854280 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3f1da767-db37-4663-89a6-40986a5d8935 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:46.860243 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3f1da767-db37-4663-89a6-40986a5d8935 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:46.860723 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3f1da767-db37-4663-89a6-40986a5d8935 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:46.861151 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3f1da767-db37-4663-89a6-40986a5d8935 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:46.861890 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3f1da767-db37-4663-89a6-40986a5d8935 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:46.862334 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3f1da767-db37-4663-89a6-40986a5d8935 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:46.862749 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3f1da767-db37-4663-89a6-40986a5d8935 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:46.990748 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3f1da767-db37-4663-89a6-40986a5d8935 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:46.999127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3f1da767-db37-4663-89a6-40986a5d8935 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 200 len: 1367 microversion: 2.1 time: 0.149415 Sep 27 16:40:47.004027 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 284/597] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:46 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:47.464866 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d7d4a19f-92fa-4dca-b526-4d3a81ba58c1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:47.465549 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d7d4a19f-92fa-4dca-b526-4d3a81ba58c1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:47.471587 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7d4a19f-92fa-4dca-b526-4d3a81ba58c1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:47.474191 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7d4a19f-92fa-4dca-b526-4d3a81ba58c1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:47.474191 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7d4a19f-92fa-4dca-b526-4d3a81ba58c1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:47.474191 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7d4a19f-92fa-4dca-b526-4d3a81ba58c1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:47.474191 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7d4a19f-92fa-4dca-b526-4d3a81ba58c1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:47.474629 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7d4a19f-92fa-4dca-b526-4d3a81ba58c1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:47.547548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a3eb0d54-cc07-4a4d-a8bd-b7cee71e5e15 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:47.549986 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a3eb0d54-cc07-4a4d-a8bd-b7cee71e5e15 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:47.556600 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3eb0d54-cc07-4a4d-a8bd-b7cee71e5e15 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:47.557062 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3eb0d54-cc07-4a4d-a8bd-b7cee71e5e15 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:47.557489 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3eb0d54-cc07-4a4d-a8bd-b7cee71e5e15 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:47.558178 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3eb0d54-cc07-4a4d-a8bd-b7cee71e5e15 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:47.558626 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3eb0d54-cc07-4a4d-a8bd-b7cee71e5e15 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:47.559097 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3eb0d54-cc07-4a4d-a8bd-b7cee71e5e15 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:47.588998 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a3eb0d54-cc07-4a4d-a8bd-b7cee71e5e15 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046107 Sep 27 16:40:47.589560 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 285/598] 10.222.0.64 () {60 vars in 1343 bytes} [Tue Sep 27 16:40:47 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 16:40:47.618198 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d7d4a19f-92fa-4dca-b526-4d3a81ba58c1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:47.620220 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-939c300a-fa4d-43ca-b478-26ccea9cf09b tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:47.620824 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-939c300a-fa4d-43ca-b478-26ccea9cf09b tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:47.627153 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d7d4a19f-92fa-4dca-b526-4d3a81ba58c1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1757 microversion: 2.1 time: 0.165995 Sep 27 16:40:47.627780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-939c300a-fa4d-43ca-b478-26ccea9cf09b tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:47.627929 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 314/599] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:47 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:47.628265 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-939c300a-fa4d-43ca-b478-26ccea9cf09b tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:47.628893 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-939c300a-fa4d-43ca-b478-26ccea9cf09b tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:47.629484 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-939c300a-fa4d-43ca-b478-26ccea9cf09b tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:47.629935 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-939c300a-fa4d-43ca-b478-26ccea9cf09b tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:47.630353 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-939c300a-fa4d-43ca-b478-26ccea9cf09b tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:47.775769 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-939c300a-fa4d-43ca-b478-26ccea9cf09b tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:47.784599 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-939c300a-fa4d-43ca-b478-26ccea9cf09b tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a" status: 200 len: 1319 microversion: 2.1 time: 0.168180 Sep 27 16:40:47.785173 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 286/600] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:47 2022] GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:40:48.023842 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-37c0ef47-8a40-4049-8268-2ec7f08a0c91 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:48.024459 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-37c0ef47-8a40-4049-8268-2ec7f08a0c91 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:48.031153 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-37c0ef47-8a40-4049-8268-2ec7f08a0c91 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:48.031738 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-37c0ef47-8a40-4049-8268-2ec7f08a0c91 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:48.032186 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-37c0ef47-8a40-4049-8268-2ec7f08a0c91 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:48.033269 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-37c0ef47-8a40-4049-8268-2ec7f08a0c91 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:48.033737 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-37c0ef47-8a40-4049-8268-2ec7f08a0c91 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:48.034226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-37c0ef47-8a40-4049-8268-2ec7f08a0c91 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:48.163008 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-37c0ef47-8a40-4049-8268-2ec7f08a0c91 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:48.170663 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-37c0ef47-8a40-4049-8268-2ec7f08a0c91 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 200 len: 1556 microversion: 2.1 time: 0.151251 Sep 27 16:40:48.171253 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 315/601] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:48 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:48.192817 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c2bb79d6-d58b-4dbb-af67-e3dc2d4fafb4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:48.193237 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c2bb79d6-d58b-4dbb-af67-e3dc2d4fafb4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:48.199063 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c2bb79d6-d58b-4dbb-af67-e3dc2d4fafb4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:48.199538 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c2bb79d6-d58b-4dbb-af67-e3dc2d4fafb4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:48.200614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c2bb79d6-d58b-4dbb-af67-e3dc2d4fafb4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:48.201349 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c2bb79d6-d58b-4dbb-af67-e3dc2d4fafb4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:48.201794 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c2bb79d6-d58b-4dbb-af67-e3dc2d4fafb4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:48.202209 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c2bb79d6-d58b-4dbb-af67-e3dc2d4fafb4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:48.276940 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c2bb79d6-d58b-4dbb-af67-e3dc2d4fafb4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087919 Sep 27 16:40:48.277532 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 287/602] 10.222.0.64 () {58 vars in 1275 bytes} [Tue Sep 27 16:40:48 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:40:48.602670 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6100dcc0-9d46-4499-b551-209edd0f989a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:48.605098 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6100dcc0-9d46-4499-b551-209edd0f989a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:48.612772 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6100dcc0-9d46-4499-b551-209edd0f989a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:48.613273 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6100dcc0-9d46-4499-b551-209edd0f989a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:48.613721 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6100dcc0-9d46-4499-b551-209edd0f989a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:48.614429 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6100dcc0-9d46-4499-b551-209edd0f989a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:48.615129 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6100dcc0-9d46-4499-b551-209edd0f989a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:48.615563 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6100dcc0-9d46-4499-b551-209edd0f989a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:48.649539 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-43efe979-568d-44cf-861a-37345db0b8a1 req-20e69312-bf92-4788-b42d-7332f1db4817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "917a245d-3957-45a3-a011-67b79c56ea0a", "name": "network-vif-plugged", "status": "completed", "tag": "22b2a016-09d8-4486-8dd8-f824c8714bbe"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:40:48.650144 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6100dcc0-9d46-4499-b551-209edd0f989a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051499 Sep 27 16:40:48.656516 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 316/603] 10.222.0.64 () {60 vars in 1343 bytes} [Tue Sep 27 16:40:48 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:48.661118 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-43efe979-568d-44cf-861a-37345db0b8a1 req-20e69312-bf92-4788-b42d-7332f1db4817 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:48.661652 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-43efe979-568d-44cf-861a-37345db0b8a1 req-20e69312-bf92-4788-b42d-7332f1db4817 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:48.662254 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-43efe979-568d-44cf-861a-37345db0b8a1 req-20e69312-bf92-4788-b42d-7332f1db4817 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:48.668461 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e971eb9c-55bf-45e2-aab7-8aa2a33abfde tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:48.669274 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e971eb9c-55bf-45e2-aab7-8aa2a33abfde tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:48.676280 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e971eb9c-55bf-45e2-aab7-8aa2a33abfde tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:48.676514 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-43efe979-568d-44cf-861a-37345db0b8a1 req-20e69312-bf92-4788-b42d-7332f1db4817 service nova] Creating event network-vif-plugged:22b2a016-09d8-4486-8dd8-f824c8714bbe for instance 917a245d-3957-45a3-a011-67b79c56ea0a on hv-cinder-85506 Sep 27 16:40:48.676719 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e971eb9c-55bf-45e2-aab7-8aa2a33abfde tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:48.677165 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e971eb9c-55bf-45e2-aab7-8aa2a33abfde tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:48.677877 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e971eb9c-55bf-45e2-aab7-8aa2a33abfde tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:48.678507 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e971eb9c-55bf-45e2-aab7-8aa2a33abfde tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:48.679117 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e971eb9c-55bf-45e2-aab7-8aa2a33abfde tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:48.681888 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-43efe979-568d-44cf-861a-37345db0b8a1 req-20e69312-bf92-4788-b42d-7332f1db4817 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036910 Sep 27 16:40:48.683300 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 288/604] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:40:48.744343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c1c1b6b0-7df5-4de1-9f1d-08bdde8c69ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:48.746492 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c1c1b6b0-7df5-4de1-9f1d-08bdde8c69ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:48.757222 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1c1b6b0-7df5-4de1-9f1d-08bdde8c69ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:48.757718 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1c1b6b0-7df5-4de1-9f1d-08bdde8c69ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:48.758158 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1c1b6b0-7df5-4de1-9f1d-08bdde8c69ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:48.758953 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1c1b6b0-7df5-4de1-9f1d-08bdde8c69ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:48.759412 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1c1b6b0-7df5-4de1-9f1d-08bdde8c69ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:48.759875 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1c1b6b0-7df5-4de1-9f1d-08bdde8c69ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:48.791376 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c1c1b6b0-7df5-4de1-9f1d-08bdde8c69ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 16:40:48.886129 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e971eb9c-55bf-45e2-aab7-8aa2a33abfde tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:48.894665 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e971eb9c-55bf-45e2-aab7-8aa2a33abfde tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1757 microversion: 2.1 time: 0.230754 Sep 27 16:40:48.895305 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 317/605] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:48 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1757 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:48.899914 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f48bea0c-f014-4c02-8343-9a662f119892 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:48.900529 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f48bea0c-f014-4c02-8343-9a662f119892 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:48.906295 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f48bea0c-f014-4c02-8343-9a662f119892 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:48.906804 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f48bea0c-f014-4c02-8343-9a662f119892 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:48.907256 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f48bea0c-f014-4c02-8343-9a662f119892 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:48.908574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f48bea0c-f014-4c02-8343-9a662f119892 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:48.908768 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f48bea0c-f014-4c02-8343-9a662f119892 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:48.909197 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f48bea0c-f014-4c02-8343-9a662f119892 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:49.123265 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c1c1b6b0-7df5-4de1-9f1d-08bdde8c69ac tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 204 len: 0 microversion: 2.20 time: 0.382977 Sep 27 16:40:49.123984 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 289/606] 10.222.0.64 () {60 vars in 1280 bytes} [Tue Sep 27 16:40:48 2022] DELETE /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 27 16:40:49.128258 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f48bea0c-f014-4c02-8343-9a662f119892 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:49.133140 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e8c1f244-287f-4851-9bdf-8584477f5dd3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:49.133951 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e8c1f244-287f-4851-9bdf-8584477f5dd3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:49.136126 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f48bea0c-f014-4c02-8343-9a662f119892 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a" status: 200 len: 1319 microversion: 2.1 time: 0.239833 Sep 27 16:40:49.136868 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 318/607] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:48 2022] GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:49.155429 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8c1f244-287f-4851-9bdf-8584477f5dd3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:49.156003 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8c1f244-287f-4851-9bdf-8584477f5dd3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:49.156516 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8c1f244-287f-4851-9bdf-8584477f5dd3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:49.157276 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8c1f244-287f-4851-9bdf-8584477f5dd3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:49.158059 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8c1f244-287f-4851-9bdf-8584477f5dd3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:49.158541 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8c1f244-287f-4851-9bdf-8584477f5dd3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:49.395297 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e8c1f244-287f-4851-9bdf-8584477f5dd3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:49.404097 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e8c1f244-287f-4851-9bdf-8584477f5dd3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:49.405604 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e8c1f244-287f-4851-9bdf-8584477f5dd3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:49.406755 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e8c1f244-287f-4851-9bdf-8584477f5dd3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1723 microversion: 2.20 time: 0.278562 Sep 27 16:40:49.407367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 290/608] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:40:49 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:40:49.800578 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-25efbb5a-a607-4777-9f49-f39f58f261e6 req-ba77950a-33b2-4a15-808d-c86cb42da460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e036d20a-962b-4196-8b51-1edc199c9700", "tag": "9a15757f-ac3b-4ddc-80eb-dac8224d7ea4"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:40:49.810475 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-25efbb5a-a607-4777-9f49-f39f58f261e6 req-ba77950a-33b2-4a15-808d-c86cb42da460 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:49.810984 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-25efbb5a-a607-4777-9f49-f39f58f261e6 req-ba77950a-33b2-4a15-808d-c86cb42da460 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:49.811420 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-25efbb5a-a607-4777-9f49-f39f58f261e6 req-ba77950a-33b2-4a15-808d-c86cb42da460 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:49.823423 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-25efbb5a-a607-4777-9f49-f39f58f261e6 req-ba77950a-33b2-4a15-808d-c86cb42da460 service nova] Creating event network-changed:9a15757f-ac3b-4ddc-80eb-dac8224d7ea4 for instance e036d20a-962b-4196-8b51-1edc199c9700 on hv-cinder-85506 Sep 27 16:40:49.829181 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-25efbb5a-a607-4777-9f49-f39f58f261e6 req-ba77950a-33b2-4a15-808d-c86cb42da460 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032239 Sep 27 16:40:49.829766 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 319/609] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:40:49.917505 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e3720d77-9408-4293-bcf7-4ac7850c86a0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:49.918200 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e3720d77-9408-4293-bcf7-4ac7850c86a0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:49.925136 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e3720d77-9408-4293-bcf7-4ac7850c86a0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:49.925752 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e3720d77-9408-4293-bcf7-4ac7850c86a0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:49.926167 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e3720d77-9408-4293-bcf7-4ac7850c86a0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:49.926912 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e3720d77-9408-4293-bcf7-4ac7850c86a0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:49.927367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e3720d77-9408-4293-bcf7-4ac7850c86a0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:49.927790 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e3720d77-9408-4293-bcf7-4ac7850c86a0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:50.078204 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e3720d77-9408-4293-bcf7-4ac7850c86a0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:50.086659 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e3720d77-9408-4293-bcf7-4ac7850c86a0 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1757 microversion: 2.1 time: 0.173038 Sep 27 16:40:50.087262 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 291/610] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:49 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:50.160925 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-552ad83d-5416-49d4-b823-548779f7ebb1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:50.161827 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-552ad83d-5416-49d4-b823-548779f7ebb1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:50.168313 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-552ad83d-5416-49d4-b823-548779f7ebb1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:50.169322 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-552ad83d-5416-49d4-b823-548779f7ebb1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:50.169946 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-552ad83d-5416-49d4-b823-548779f7ebb1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:50.170648 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-552ad83d-5416-49d4-b823-548779f7ebb1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:50.171139 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-552ad83d-5416-49d4-b823-548779f7ebb1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:50.171693 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-552ad83d-5416-49d4-b823-548779f7ebb1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:50.301648 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-552ad83d-5416-49d4-b823-548779f7ebb1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:50.310035 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-552ad83d-5416-49d4-b823-548779f7ebb1 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a" status: 200 len: 1319 microversion: 2.1 time: 0.153248 Sep 27 16:40:50.310609 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 320/611] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:50 2022] GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:40:50.431945 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b617ce0a-6081-438c-8bdf-09e00a588f03 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:50.432640 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b617ce0a-6081-438c-8bdf-09e00a588f03 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:50.439091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b617ce0a-6081-438c-8bdf-09e00a588f03 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:50.439690 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b617ce0a-6081-438c-8bdf-09e00a588f03 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:50.440158 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b617ce0a-6081-438c-8bdf-09e00a588f03 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:50.440853 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b617ce0a-6081-438c-8bdf-09e00a588f03 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:50.441303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b617ce0a-6081-438c-8bdf-09e00a588f03 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:50.441726 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b617ce0a-6081-438c-8bdf-09e00a588f03 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:50.575582 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b617ce0a-6081-438c-8bdf-09e00a588f03 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:50.584785 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b617ce0a-6081-438c-8bdf-09e00a588f03 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:50.586250 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b617ce0a-6081-438c-8bdf-09e00a588f03 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:50.587478 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b617ce0a-6081-438c-8bdf-09e00a588f03 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1723 microversion: 2.20 time: 0.159394 Sep 27 16:40:50.594515 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 292/612] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:40:50 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:40:51.109814 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e11859e6-7800-4fde-be5d-3e3f935ef494 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:51.110425 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e11859e6-7800-4fde-be5d-3e3f935ef494 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:51.116464 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e11859e6-7800-4fde-be5d-3e3f935ef494 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:51.116949 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e11859e6-7800-4fde-be5d-3e3f935ef494 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:51.117385 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e11859e6-7800-4fde-be5d-3e3f935ef494 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:51.118097 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e11859e6-7800-4fde-be5d-3e3f935ef494 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:51.118570 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e11859e6-7800-4fde-be5d-3e3f935ef494 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:51.119022 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e11859e6-7800-4fde-be5d-3e3f935ef494 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:51.259590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e11859e6-7800-4fde-be5d-3e3f935ef494 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:51.268556 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e11859e6-7800-4fde-be5d-3e3f935ef494 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1757 microversion: 2.1 time: 0.162766 Sep 27 16:40:51.269117 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 321/613] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:51 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:51.333166 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c2b3f7ba-df9d-49cc-9557-735d66605300 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:51.333839 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c2b3f7ba-df9d-49cc-9557-735d66605300 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:51.340308 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c2b3f7ba-df9d-49cc-9557-735d66605300 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:51.341427 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c2b3f7ba-df9d-49cc-9557-735d66605300 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:51.341878 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c2b3f7ba-df9d-49cc-9557-735d66605300 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:51.342586 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c2b3f7ba-df9d-49cc-9557-735d66605300 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:51.343123 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c2b3f7ba-df9d-49cc-9557-735d66605300 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:51.343550 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c2b3f7ba-df9d-49cc-9557-735d66605300 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:51.473360 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c2b3f7ba-df9d-49cc-9557-735d66605300 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:51.480865 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c2b3f7ba-df9d-49cc-9557-735d66605300 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a" status: 200 len: 1319 microversion: 2.1 time: 0.151549 Sep 27 16:40:51.481426 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 293/614] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:51 2022] GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:51.618599 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d19f7051-e92b-48b0-874b-138b19627a96 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:51.619332 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d19f7051-e92b-48b0-874b-138b19627a96 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:51.627482 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d19f7051-e92b-48b0-874b-138b19627a96 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:51.628125 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d19f7051-e92b-48b0-874b-138b19627a96 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:51.628558 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d19f7051-e92b-48b0-874b-138b19627a96 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:51.629241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d19f7051-e92b-48b0-874b-138b19627a96 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:51.629701 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d19f7051-e92b-48b0-874b-138b19627a96 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:51.630123 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d19f7051-e92b-48b0-874b-138b19627a96 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:51.648280 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:51.769744 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d19f7051-e92b-48b0-874b-138b19627a96 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:51.778440 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d19f7051-e92b-48b0-874b-138b19627a96 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:51.779923 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d19f7051-e92b-48b0-874b-138b19627a96 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:51.781099 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d19f7051-e92b-48b0-874b-138b19627a96 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1723 microversion: 2.20 time: 0.166428 Sep 27 16:40:51.781688 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 322/615] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:40:51 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:40:52.291120 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3b092709-38c7-4823-84f3-07903221155c tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:52.291734 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3b092709-38c7-4823-84f3-07903221155c tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:52.294306 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:52.299022 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b092709-38c7-4823-84f3-07903221155c tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:52.299508 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b092709-38c7-4823-84f3-07903221155c tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:52.299948 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b092709-38c7-4823-84f3-07903221155c tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:52.300649 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b092709-38c7-4823-84f3-07903221155c tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:52.301108 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b092709-38c7-4823-84f3-07903221155c tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:52.301532 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b092709-38c7-4823-84f3-07903221155c tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:52.462163 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3b092709-38c7-4823-84f3-07903221155c tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:52.471470 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3b092709-38c7-4823-84f3-07903221155c tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1757 microversion: 2.1 time: 0.184204 Sep 27 16:40:52.474800 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 294/616] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:52 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:52.503382 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-adc483e1-cb31-4fb3-b77c-5c0a4c0136a8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:52.504007 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-adc483e1-cb31-4fb3-b77c-5c0a4c0136a8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:52.510162 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-adc483e1-cb31-4fb3-b77c-5c0a4c0136a8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:52.510644 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-adc483e1-cb31-4fb3-b77c-5c0a4c0136a8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:52.511115 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-adc483e1-cb31-4fb3-b77c-5c0a4c0136a8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:52.511807 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-adc483e1-cb31-4fb3-b77c-5c0a4c0136a8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:52.512791 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-adc483e1-cb31-4fb3-b77c-5c0a4c0136a8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:52.513210 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-adc483e1-cb31-4fb3-b77c-5c0a4c0136a8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:52.646259 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-adc483e1-cb31-4fb3-b77c-5c0a4c0136a8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:52.655439 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-adc483e1-cb31-4fb3-b77c-5c0a4c0136a8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a" status: 200 len: 1319 microversion: 2.1 time: 0.155902 Sep 27 16:40:52.656070 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 323/617] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:52 2022] GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:52.807051 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0d892096-fa98-402e-b85d-2da1327f9045 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:52.807733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0d892096-fa98-402e-b85d-2da1327f9045 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:52.813966 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d892096-fa98-402e-b85d-2da1327f9045 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:52.814457 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d892096-fa98-402e-b85d-2da1327f9045 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:52.814915 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d892096-fa98-402e-b85d-2da1327f9045 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:52.815614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d892096-fa98-402e-b85d-2da1327f9045 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:52.816087 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d892096-fa98-402e-b85d-2da1327f9045 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:52.816493 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d892096-fa98-402e-b85d-2da1327f9045 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:52.951598 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0d892096-fa98-402e-b85d-2da1327f9045 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:52.955051 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:40:52.960233 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0d892096-fa98-402e-b85d-2da1327f9045 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:52.963576 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0d892096-fa98-402e-b85d-2da1327f9045 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:52.964787 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0d892096-fa98-402e-b85d-2da1327f9045 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1723 microversion: 2.20 time: 0.161802 Sep 27 16:40:52.965833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 295/618] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:40:52 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:40:53.496329 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-5af6c27b-1ab1-484c-a8d8-50a4c99e037a req-64c7ac2f-5374-457b-b7fd-566acdc0373a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84acf37-9445-48cd-a921-12a7a3c301d9", "name": "network-vif-deleted", "tag": "184e6faa-be62-4210-acc1-64aceea7f1f0"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:40:53.497282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6ce56d81-050b-4632-b0d1-f28ca7bba3e2 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:53.497778 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6ce56d81-050b-4632-b0d1-f28ca7bba3e2 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:53.504268 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ce56d81-050b-4632-b0d1-f28ca7bba3e2 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:53.504958 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ce56d81-050b-4632-b0d1-f28ca7bba3e2 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:53.505722 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ce56d81-050b-4632-b0d1-f28ca7bba3e2 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:53.506432 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ce56d81-050b-4632-b0d1-f28ca7bba3e2 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:53.506908 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ce56d81-050b-4632-b0d1-f28ca7bba3e2 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:53.507501 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ce56d81-050b-4632-b0d1-f28ca7bba3e2 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:53.509139 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-5af6c27b-1ab1-484c-a8d8-50a4c99e037a req-64c7ac2f-5374-457b-b7fd-566acdc0373a service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:53.509685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-5af6c27b-1ab1-484c-a8d8-50a4c99e037a req-64c7ac2f-5374-457b-b7fd-566acdc0373a service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:53.510195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-5af6c27b-1ab1-484c-a8d8-50a4c99e037a req-64c7ac2f-5374-457b-b7fd-566acdc0373a service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:53.522960 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-5af6c27b-1ab1-484c-a8d8-50a4c99e037a req-64c7ac2f-5374-457b-b7fd-566acdc0373a service nova] Creating event network-vif-deleted:184e6faa-be62-4210-acc1-64aceea7f1f0 for instance f84acf37-9445-48cd-a921-12a7a3c301d9 on hv-cinder-85506 Sep 27 16:40:53.528558 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-5af6c27b-1ab1-484c-a8d8-50a4c99e037a req-64c7ac2f-5374-457b-b7fd-566acdc0373a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036475 Sep 27 16:40:53.529857 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 324/619] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:40:53.681122 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6ce56d81-050b-4632-b0d1-f28ca7bba3e2 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:53.686500 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9c613251-a424-494b-9bde-9e5969d111be tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:53.687741 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9c613251-a424-494b-9bde-9e5969d111be tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:53.694793 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c613251-a424-494b-9bde-9e5969d111be tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:53.695549 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c613251-a424-494b-9bde-9e5969d111be tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:53.696659 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c613251-a424-494b-9bde-9e5969d111be tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:53.697056 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6ce56d81-050b-4632-b0d1-f28ca7bba3e2 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1757 microversion: 2.1 time: 0.204915 Sep 27 16:40:53.697618 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c613251-a424-494b-9bde-9e5969d111be tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:53.698491 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c613251-a424-494b-9bde-9e5969d111be tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:53.699173 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c613251-a424-494b-9bde-9e5969d111be tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:53.716193 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 296/620] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:53 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1757 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:53.862854 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9c613251-a424-494b-9bde-9e5969d111be tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:53.873940 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9c613251-a424-494b-9bde-9e5969d111be tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a" status: 200 len: 1508 microversion: 2.1 time: 0.196389 Sep 27 16:40:53.874606 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 325/621] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:53 2022] GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a => generated 1508 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:53.898732 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5dca5972-0fd2-4408-ad22-ceac4e5c60da tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ad36316-aad1-4870-96f6-6e46b6884103", "device": "/dev/sdb"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:40:53.901873 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5dca5972-0fd2-4408-ad22-ceac4e5c60da tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:53.909499 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5dca5972-0fd2-4408-ad22-ceac4e5c60da tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:53.909988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5dca5972-0fd2-4408-ad22-ceac4e5c60da tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:53.910417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5dca5972-0fd2-4408-ad22-ceac4e5c60da tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:53.911166 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5dca5972-0fd2-4408-ad22-ceac4e5c60da tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:53.911620 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5dca5972-0fd2-4408-ad22-ceac4e5c60da tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:53.912039 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5dca5972-0fd2-4408-ad22-ceac4e5c60da tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:53.992094 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-999a3a18-c4e4-4161-a474-8aa9b98b4b1b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:53.992912 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-999a3a18-c4e4-4161-a474-8aa9b98b4b1b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:54.004666 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-999a3a18-c4e4-4161-a474-8aa9b98b4b1b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:54.005374 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-999a3a18-c4e4-4161-a474-8aa9b98b4b1b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:54.007110 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-999a3a18-c4e4-4161-a474-8aa9b98b4b1b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:54.008127 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-999a3a18-c4e4-4161-a474-8aa9b98b4b1b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:54.008745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-999a3a18-c4e4-4161-a474-8aa9b98b4b1b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:54.009334 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-999a3a18-c4e4-4161-a474-8aa9b98b4b1b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:54.053636 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-999a3a18-c4e4-4161-a474-8aa9b98b4b1b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:54.054315 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-999a3a18-c4e4-4161-a474-8aa9b98b4b1b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:54.054985 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-999a3a18-c4e4-4161-a474-8aa9b98b4b1b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:54.055588 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-999a3a18-c4e4-4161-a474-8aa9b98b4b1b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lazy-loading 'fault' on Instance uuid f84acf37-9445-48cd-a921-12a7a3c301d9 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:40:54.102300 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-999a3a18-c4e4-4161-a474-8aa9b98b4b1b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:54.109586 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-999a3a18-c4e4-4161-a474-8aa9b98b4b1b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:54.111067 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-999a3a18-c4e4-4161-a474-8aa9b98b4b1b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:54.112230 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-999a3a18-c4e4-4161-a474-8aa9b98b4b1b tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 200 len: 1371 microversion: 2.20 time: 0.124568 Sep 27 16:40:54.112887 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 326/622] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:40:53 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 1371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:40:54.641123 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5dca5972-0fd2-4408-ad22-ceac4e5c60da tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "POST /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.746666 Sep 27 16:40:54.645507 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 297/623] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Sep 27 16:40:53 2022] POST /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a/os-volume_attachments => generated 194 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:40:54.720530 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2a9e70db-24dd-493c-aed6-3ac30cdddd6e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:54.721199 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2a9e70db-24dd-493c-aed6-3ac30cdddd6e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:54.727263 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2a9e70db-24dd-493c-aed6-3ac30cdddd6e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:54.729393 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2a9e70db-24dd-493c-aed6-3ac30cdddd6e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:54.729393 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2a9e70db-24dd-493c-aed6-3ac30cdddd6e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:54.729393 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2a9e70db-24dd-493c-aed6-3ac30cdddd6e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:54.729393 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2a9e70db-24dd-493c-aed6-3ac30cdddd6e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:54.729909 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2a9e70db-24dd-493c-aed6-3ac30cdddd6e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:54.889554 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2a9e70db-24dd-493c-aed6-3ac30cdddd6e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:54.898252 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2a9e70db-24dd-493c-aed6-3ac30cdddd6e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1757 microversion: 2.1 time: 0.181633 Sep 27 16:40:54.899428 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 327/624] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:54 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:55.141716 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a3e336f0-1cf8-4765-8a47-60ee5c1c1541 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:55.142408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a3e336f0-1cf8-4765-8a47-60ee5c1c1541 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:55.149066 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3e336f0-1cf8-4765-8a47-60ee5c1c1541 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:55.149547 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3e336f0-1cf8-4765-8a47-60ee5c1c1541 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:55.149978 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3e336f0-1cf8-4765-8a47-60ee5c1c1541 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:55.153321 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3e336f0-1cf8-4765-8a47-60ee5c1c1541 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:55.153321 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3e336f0-1cf8-4765-8a47-60ee5c1c1541 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:55.153321 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3e336f0-1cf8-4765-8a47-60ee5c1c1541 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:55.165442 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-a3e336f0-1cf8-4765-8a47-60ee5c1c1541 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] HTTP exception thrown: Instance f84acf37-9445-48cd-a921-12a7a3c301d9 could not be found. Sep 27 16:40:55.167070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a3e336f0-1cf8-4765-8a47-60ee5c1c1541 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Request method failure captured: Sep 27 16:40:55.167070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 HTTP/1.1 Sep 27 16:40:55.167070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:40:55.167070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:40:55.167070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:40:55.167070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 27 16:40:55.167070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:40:55.167070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:40:55.167070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:40:55.167070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:40:55.167070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMyaWfTwBhIv8VoCuCi39_gxY9i4xSwqXg0VrZruLd6f3-bRzY6-ACesCZRa0ZexfyVrHnrBnUchfcy1jlih-TbjFX0crQ_L9uQk_Lo0mx0-lna7pK5N1zbzzZb0_G8C37IPZNpeHs6gmTjI_mB-uRDlJczN3eF0mNXxDjrmVclKRRQM Sep 27 16:40:55.167070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:40:55.167070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:40:55.167070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:40:55.167070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:40:55.167070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Openstack-Nova-Api-Version: 2.20 Sep 27 16:40:55.167070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:40:55.167070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:40:55.167070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: 41cca09950c34cc7baded0eb0a42bb07 Sep 27 16:40:55.167070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-480632448 Sep 27 16:40:55.167070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:40:55.167070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:40:55.169296 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:40:55.169296 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeShelveTestJSON-480632448 Sep 27 16:40:55.169296 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 41cca09950c34cc7baded0eb0a42bb07 Sep 27 16:40:55.169296 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-480632448 Sep 27 16:40:55.169296 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeShelveTestJSON-480632448-project Sep 27 16:40:55.169296 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:40:55.169296 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:40:55.169296 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: 1dbfb1a3e99c418098c2b02aea93b923 Sep 27 16:40:55.169296 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeShelveTestJSON-480632448-project Sep 27 16:40:55.169296 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: > Sep 27 16:40:55.169296 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Instance f84acf37-9445-48cd-a921-12a7a3c301d9 could not be found. Sep 27 16:40:55.169296 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'id': 'f84acf37-9445-48cd-a921-12a7a3c301d9'} Sep 27 16:40:55.170223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:40:55.170223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:40:55.170223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:40:55.170223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:40:55.170223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:40:55.170223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:40:55.170223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:40:55.170223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:40:55.170223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:40:55.170223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:40:55.170223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f84acf37-9445-48cd-a921-12a7a3c301d9 could not be found. Sep 27 16:40:55.170223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:40:55.170223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:40:55.170223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:40:55.170223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:40:55.170223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:40:55.170223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:40:55.170223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:40:55.170223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:40:55.170223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:40:55.171780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:40:55.171780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:40:55.171780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:40:55.171780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:40:55.171780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:40:55.171780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:40:55.171780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:40:55.171780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f84acf37-9445-48cd-a921-12a7a3c301d9 could not be found. Sep 27 16:40:55.171780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:40:55.171780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:40:55.171780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:40:55.171780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:40:55.171780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:40:55.171780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:40:55.171780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:40:55.171780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:40:55.171780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f84acf37-9445-48cd-a921-12a7a3c301d9 could not be found. Sep 27 16:40:55.171780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:40:55.173073 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a3e336f0-1cf8-4765-8a47-60ee5c1c1541 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Returning 404 to user: Instance f84acf37-9445-48cd-a921-12a7a3c301d9 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:40:55.173073 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a3e336f0-1cf8-4765-8a47-60ee5c1c1541 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 404 len: 111 microversion: 2.20 time: 0.031806 Sep 27 16:40:55.173073 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 298/625] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:40:55 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 16:40:55.178394 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-13162963-abcf-411d-b35a-450ab2e8526f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '.version_select at 0x7fa405c1ea60>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:55.260206 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-13162963-abcf-411d-b35a-450ab2e8526f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2024487446" status: 204 len: 0 microversion: 2.20 time: 0.085553 Sep 27 16:40:55.260816 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 328/626] 10.222.0.64 () {60 vars in 1262 bytes} [Tue Sep 27 16:40:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2024487446 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 16:40:55.923448 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-15998cef-8881-4994-b5a7-6cf728a3095e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:55.924115 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-15998cef-8881-4994-b5a7-6cf728a3095e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:55.930509 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15998cef-8881-4994-b5a7-6cf728a3095e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:55.931096 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15998cef-8881-4994-b5a7-6cf728a3095e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:55.931534 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15998cef-8881-4994-b5a7-6cf728a3095e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:55.932216 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15998cef-8881-4994-b5a7-6cf728a3095e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:55.932667 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15998cef-8881-4994-b5a7-6cf728a3095e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:55.933261 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15998cef-8881-4994-b5a7-6cf728a3095e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:56.065466 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ff6c1a7c-d0e4-4ad0-9861-d7f430879948 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Action: 'create', calling method: .version_select at 0x7fa405a89940>, body: {"keypair": {"name": "tempest-keypair-2068111148", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2t6ggfurE0c9wQ1X8jOQ+QR5xYs2jT5yzXgoe/w7LKgi2kII+BaAlA1KL7Ycu3rpSA8sIArcljjkRKNldT3KdgKFcMNl15Hz5gUVDnOvIzyzes27c5D61pF1LipBEfdw=="}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:40:56.081797 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-ff6c1a7c-d0e4-4ad0-9861-d7f430879948 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Getting quotas for project 41cca09950c34cc7baded0eb0a42bb07. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:40:56.082953 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-15998cef-8881-4994-b5a7-6cf728a3095e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:56.085832 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-ff6c1a7c-d0e4-4ad0-9861-d7f430879948 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Getting quotas for user 1dbfb1a3e99c418098c2b02aea93b923 and project 41cca09950c34cc7baded0eb0a42bb07. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:40:56.091950 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-15998cef-8881-4994-b5a7-6cf728a3095e tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1757 microversion: 2.1 time: 0.173089 Sep 27 16:40:56.092519 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 299/627] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:55 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:56.180524 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ff6c1a7c-d0e4-4ad0-9861-d7f430879948 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.119727 Sep 27 16:40:56.181127 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 329/628] 10.222.0.64 () {62 vars in 1200 bytes} [Tue Sep 27 16:40:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 27 16:40:57.115651 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c3af42ff-08cb-4392-aee4-93c57fd171aa tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:57.116292 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c3af42ff-08cb-4392-aee4-93c57fd171aa tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:57.122982 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3af42ff-08cb-4392-aee4-93c57fd171aa tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:57.123495 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3af42ff-08cb-4392-aee4-93c57fd171aa tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:57.125112 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3af42ff-08cb-4392-aee4-93c57fd171aa tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:57.125853 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3af42ff-08cb-4392-aee4-93c57fd171aa tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:57.126314 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3af42ff-08cb-4392-aee4-93c57fd171aa tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:57.126744 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3af42ff-08cb-4392-aee4-93c57fd171aa tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:57.276831 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c3af42ff-08cb-4392-aee4-93c57fd171aa tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:57.286465 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c3af42ff-08cb-4392-aee4-93c57fd171aa tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1760 microversion: 2.1 time: 0.174710 Sep 27 16:40:57.287502 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 300/629] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:40:57 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1760 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:40:58.476938 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b1a9d404-2e5c-49f3-bf98-80e27f629172 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2003710083", "imageRef": "6908a343-46fa-4801-bfb5-7ad92ac26956", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34ae499e-6ac1-41bb-a843-2b013f2ce3f9"}], "security_groups": [{"name": "tempest-securitygroup--141447483"}], "key_name": "tempest-keypair-2068111148", "user_data": "}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:40:58.577934 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-b1a9d404-2e5c-49f3-bf98-80e27f629172 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] validate_networks() for [('34ae499e-6ac1-41bb-a843-2b013f2ce3f9', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 16:40:58.944355 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-b1a9d404-2e5c-49f3-bf98-80e27f629172 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 16:40:58.944775 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-b1a9d404-2e5c-49f3-bf98-80e27f629172 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 16:40:58.945250 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-b1a9d404-2e5c-49f3-bf98-80e27f629172 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 16:40:58.945650 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-b1a9d404-2e5c-49f3-bf98-80e27f629172 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 16:40:58.946057 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-b1a9d404-2e5c-49f3-bf98-80e27f629172 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 16:40:58.955022 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1a9d404-2e5c-49f3-bf98-80e27f629172 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:58.955508 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1a9d404-2e5c-49f3-bf98-80e27f629172 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:58.955940 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1a9d404-2e5c-49f3-bf98-80e27f629172 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:58.956658 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1a9d404-2e5c-49f3-bf98-80e27f629172 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:40:58.957107 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1a9d404-2e5c-49f3-bf98-80e27f629172 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:40:58.957527 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1a9d404-2e5c-49f3-bf98-80e27f629172 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:40:58.974893 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-b1a9d404-2e5c-49f3-bf98-80e27f629172 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Getting quotas for project 41cca09950c34cc7baded0eb0a42bb07. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:40:58.978898 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-b1a9d404-2e5c-49f3-bf98-80e27f629172 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Getting quotas for user 1dbfb1a3e99c418098c2b02aea93b923 and project 41cca09950c34cc7baded0eb0a42bb07. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:40:58.989700 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b1a9d404-2e5c-49f3-bf98-80e27f629172 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 16:40:58.992177 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b1a9d404-2e5c-49f3-bf98-80e27f629172 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6908a343-46fa-4801-bfb5-7ad92ac26956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 16:40:59.125090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b1a9d404-2e5c-49f3-bf98-80e27f629172 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.652714 Sep 27 16:40:59.125740 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 330/630] 10.222.0.64 () {62 vars in 1188 bytes} [Tue Sep 27 16:40:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 27 16:40:59.136942 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-81f1d7eb-4853-42b9-8505-e310cf824dd3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:40:59.137677 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-81f1d7eb-4853-42b9-8505-e310cf824dd3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:40:59.196423 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-81f1d7eb-4853-42b9-8505-e310cf824dd3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:59.204456 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-81f1d7eb-4853-42b9-8505-e310cf824dd3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:59.205893 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-81f1d7eb-4853-42b9-8505-e310cf824dd3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:40:59.207048 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-81f1d7eb-4853-42b9-8505-e310cf824dd3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1282 microversion: 2.20 time: 0.074152 Sep 27 16:40:59.218967 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 301/631] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:40:59 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1282 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:41:00.232428 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-98b16ff1-1f76-47fc-a118-5949892c0bf2 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:00.232972 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-98b16ff1-1f76-47fc-a118-5949892c0bf2 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:00.239052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-98b16ff1-1f76-47fc-a118-5949892c0bf2 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:00.239547 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-98b16ff1-1f76-47fc-a118-5949892c0bf2 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:00.239986 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-98b16ff1-1f76-47fc-a118-5949892c0bf2 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:00.240680 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-98b16ff1-1f76-47fc-a118-5949892c0bf2 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:00.241136 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-98b16ff1-1f76-47fc-a118-5949892c0bf2 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:00.241560 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-98b16ff1-1f76-47fc-a118-5949892c0bf2 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:00.302159 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-98b16ff1-1f76-47fc-a118-5949892c0bf2 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:00.310193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-98b16ff1-1f76-47fc-a118-5949892c0bf2 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:00.312474 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-98b16ff1-1f76-47fc-a118-5949892c0bf2 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:00.313561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-98b16ff1-1f76-47fc-a118-5949892c0bf2 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1278 microversion: 2.20 time: 0.085185 Sep 27 16:41:00.314119 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 331/632] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:41:00 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1278 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:41:01.339180 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7dc11ee5-b795-4539-8e44-9b6255e5f437 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:01.339925 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7dc11ee5-b795-4539-8e44-9b6255e5f437 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:01.347902 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7dc11ee5-b795-4539-8e44-9b6255e5f437 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:01.348391 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7dc11ee5-b795-4539-8e44-9b6255e5f437 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:01.348889 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7dc11ee5-b795-4539-8e44-9b6255e5f437 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:01.349596 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7dc11ee5-b795-4539-8e44-9b6255e5f437 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:01.350054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7dc11ee5-b795-4539-8e44-9b6255e5f437 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:01.350481 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7dc11ee5-b795-4539-8e44-9b6255e5f437 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:01.417001 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7dc11ee5-b795-4539-8e44-9b6255e5f437 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:01.425022 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7dc11ee5-b795-4539-8e44-9b6255e5f437 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:01.426463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7dc11ee5-b795-4539-8e44-9b6255e5f437 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:01.427574 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7dc11ee5-b795-4539-8e44-9b6255e5f437 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1334 microversion: 2.20 time: 0.092394 Sep 27 16:41:01.428134 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 302/633] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:41:01 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1334 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:41:02.452082 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d7be0467-7d30-4a5f-926f-35eb9df08bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:02.452746 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d7be0467-7d30-4a5f-926f-35eb9df08bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:02.458749 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7be0467-7d30-4a5f-926f-35eb9df08bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:02.459344 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7be0467-7d30-4a5f-926f-35eb9df08bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:02.459682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7be0467-7d30-4a5f-926f-35eb9df08bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:02.460548 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7be0467-7d30-4a5f-926f-35eb9df08bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:02.461156 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7be0467-7d30-4a5f-926f-35eb9df08bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:02.461585 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7be0467-7d30-4a5f-926f-35eb9df08bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:02.525104 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d7be0467-7d30-4a5f-926f-35eb9df08bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:02.534391 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d7be0467-7d30-4a5f-926f-35eb9df08bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:02.535862 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d7be0467-7d30-4a5f-926f-35eb9df08bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:02.536959 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d7be0467-7d30-4a5f-926f-35eb9df08bc7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1352 microversion: 2.20 time: 0.088921 Sep 27 16:41:02.537512 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 332/634] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:41:02 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:41:03.569109 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6a84dabe-0da3-427b-9524-acb911c12fe1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:03.569109 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6a84dabe-0da3-427b-9524-acb911c12fe1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:03.574001 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a84dabe-0da3-427b-9524-acb911c12fe1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:03.574573 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a84dabe-0da3-427b-9524-acb911c12fe1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:03.575412 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a84dabe-0da3-427b-9524-acb911c12fe1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:03.576278 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a84dabe-0da3-427b-9524-acb911c12fe1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:03.576827 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a84dabe-0da3-427b-9524-acb911c12fe1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:03.577687 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a84dabe-0da3-427b-9524-acb911c12fe1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:03.715809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6a84dabe-0da3-427b-9524-acb911c12fe1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:03.725122 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6a84dabe-0da3-427b-9524-acb911c12fe1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:03.726704 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6a84dabe-0da3-427b-9524-acb911c12fe1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:03.730841 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6a84dabe-0da3-427b-9524-acb911c12fe1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1407 microversion: 2.20 time: 0.168954 Sep 27 16:41:03.730841 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 303/635] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:41:03 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:41:03.974036 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-d694d339-51d6-46df-aec3-1d048b5563ea req-de8ee0f4-289d-41f1-b959-1db4038e7d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac", "tag": "ddb6a707-22f0-4c10-adcc-9f4d5d262645"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:41:03.985297 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-d694d339-51d6-46df-aec3-1d048b5563ea req-de8ee0f4-289d-41f1-b959-1db4038e7d5d service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:03.985783 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-d694d339-51d6-46df-aec3-1d048b5563ea req-de8ee0f4-289d-41f1-b959-1db4038e7d5d service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:03.986349 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-d694d339-51d6-46df-aec3-1d048b5563ea req-de8ee0f4-289d-41f1-b959-1db4038e7d5d service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:03.997740 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-d694d339-51d6-46df-aec3-1d048b5563ea req-de8ee0f4-289d-41f1-b959-1db4038e7d5d service nova] Creating event network-changed:ddb6a707-22f0-4c10-adcc-9f4d5d262645 for instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac on hv-cinder-85506 Sep 27 16:41:04.003271 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-d694d339-51d6-46df-aec3-1d048b5563ea req-de8ee0f4-289d-41f1-b959-1db4038e7d5d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032907 Sep 27 16:41:04.004105 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 333/636] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:41:04.752821 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c45a2221-1490-4be8-9a34-7bf4943f2ad8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:04.753467 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c45a2221-1490-4be8-9a34-7bf4943f2ad8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:04.760219 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c45a2221-1490-4be8-9a34-7bf4943f2ad8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:04.760700 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c45a2221-1490-4be8-9a34-7bf4943f2ad8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:04.761157 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c45a2221-1490-4be8-9a34-7bf4943f2ad8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:04.761843 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c45a2221-1490-4be8-9a34-7bf4943f2ad8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:04.762290 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c45a2221-1490-4be8-9a34-7bf4943f2ad8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:04.762707 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c45a2221-1490-4be8-9a34-7bf4943f2ad8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:04.894558 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c45a2221-1490-4be8-9a34-7bf4943f2ad8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:04.902605 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c45a2221-1490-4be8-9a34-7bf4943f2ad8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:04.904075 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c45a2221-1490-4be8-9a34-7bf4943f2ad8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:04.905414 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c45a2221-1490-4be8-9a34-7bf4943f2ad8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1407 microversion: 2.20 time: 0.157036 Sep 27 16:41:04.905975 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 304/637] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:41:04 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:41:05.930812 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-919e5702-0db9-4a91-ba32-ed15ee9cae3e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:05.931434 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-919e5702-0db9-4a91-ba32-ed15ee9cae3e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:05.937658 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-919e5702-0db9-4a91-ba32-ed15ee9cae3e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:05.938145 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-919e5702-0db9-4a91-ba32-ed15ee9cae3e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:05.938577 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-919e5702-0db9-4a91-ba32-ed15ee9cae3e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:05.939472 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-919e5702-0db9-4a91-ba32-ed15ee9cae3e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:05.939928 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-919e5702-0db9-4a91-ba32-ed15ee9cae3e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:05.940350 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-919e5702-0db9-4a91-ba32-ed15ee9cae3e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:06.068490 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-919e5702-0db9-4a91-ba32-ed15ee9cae3e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:06.077245 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-919e5702-0db9-4a91-ba32-ed15ee9cae3e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:06.078689 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-919e5702-0db9-4a91-ba32-ed15ee9cae3e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:06.079809 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-919e5702-0db9-4a91-ba32-ed15ee9cae3e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1407 microversion: 2.20 time: 0.153449 Sep 27 16:41:06.080361 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 334/638] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:41:05 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:41:07.104780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-27beb964-77e2-4fce-8e2e-6f8068e8e9ef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:07.105399 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-27beb964-77e2-4fce-8e2e-6f8068e8e9ef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:07.113495 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27beb964-77e2-4fce-8e2e-6f8068e8e9ef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:07.114523 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27beb964-77e2-4fce-8e2e-6f8068e8e9ef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:07.115016 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27beb964-77e2-4fce-8e2e-6f8068e8e9ef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:07.115734 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27beb964-77e2-4fce-8e2e-6f8068e8e9ef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:07.116196 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27beb964-77e2-4fce-8e2e-6f8068e8e9ef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:07.116627 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27beb964-77e2-4fce-8e2e-6f8068e8e9ef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:07.245174 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-27beb964-77e2-4fce-8e2e-6f8068e8e9ef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:07.253780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-27beb964-77e2-4fce-8e2e-6f8068e8e9ef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:07.255286 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-27beb964-77e2-4fce-8e2e-6f8068e8e9ef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:07.256395 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-27beb964-77e2-4fce-8e2e-6f8068e8e9ef tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1407 microversion: 2.20 time: 0.155548 Sep 27 16:41:07.257146 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 305/639] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:41:07 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:41:08.281642 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c7eea0f0-b499-436e-9ea3-89c795ea531c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:08.282483 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c7eea0f0-b499-436e-9ea3-89c795ea531c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:08.288519 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c7eea0f0-b499-436e-9ea3-89c795ea531c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:08.289035 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c7eea0f0-b499-436e-9ea3-89c795ea531c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:08.289441 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c7eea0f0-b499-436e-9ea3-89c795ea531c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:08.290129 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c7eea0f0-b499-436e-9ea3-89c795ea531c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:08.290582 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c7eea0f0-b499-436e-9ea3-89c795ea531c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:08.291031 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c7eea0f0-b499-436e-9ea3-89c795ea531c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:08.424118 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c7eea0f0-b499-436e-9ea3-89c795ea531c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:08.432173 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c7eea0f0-b499-436e-9ea3-89c795ea531c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:08.433621 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c7eea0f0-b499-436e-9ea3-89c795ea531c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:08.434716 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c7eea0f0-b499-436e-9ea3-89c795ea531c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1407 microversion: 2.20 time: 0.157118 Sep 27 16:41:08.435299 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 335/640] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:41:08 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:41:09.460611 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6e9789ce-1c50-4a15-84d2-25311eb547f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:09.461137 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6e9789ce-1c50-4a15-84d2-25311eb547f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:09.470416 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:09.472487 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e9789ce-1c50-4a15-84d2-25311eb547f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:09.472965 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e9789ce-1c50-4a15-84d2-25311eb547f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:09.473470 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e9789ce-1c50-4a15-84d2-25311eb547f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:09.474255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e9789ce-1c50-4a15-84d2-25311eb547f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:09.474704 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e9789ce-1c50-4a15-84d2-25311eb547f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:09.475148 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e9789ce-1c50-4a15-84d2-25311eb547f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:09.604520 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6e9789ce-1c50-4a15-84d2-25311eb547f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:09.613567 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6e9789ce-1c50-4a15-84d2-25311eb547f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:09.615045 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6e9789ce-1c50-4a15-84d2-25311eb547f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:09.616236 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6e9789ce-1c50-4a15-84d2-25311eb547f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1407 microversion: 2.20 time: 0.159560 Sep 27 16:41:09.616890 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 306/641] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:41:09 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:41:10.642092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-378113a4-ae2b-404d-913b-fd467d371b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:10.642693 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-378113a4-ae2b-404d-913b-fd467d371b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:10.644671 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:10.645315 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=10 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:10.650062 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-378113a4-ae2b-404d-913b-fd467d371b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:10.650551 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-378113a4-ae2b-404d-913b-fd467d371b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:10.651023 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-378113a4-ae2b-404d-913b-fd467d371b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:10.651720 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-378113a4-ae2b-404d-913b-fd467d371b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:10.652175 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-378113a4-ae2b-404d-913b-fd467d371b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:10.652598 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-378113a4-ae2b-404d-913b-fd467d371b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:10.784687 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-378113a4-ae2b-404d-913b-fd467d371b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:10.792736 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-378113a4-ae2b-404d-913b-fd467d371b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:10.794180 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-378113a4-ae2b-404d-913b-fd467d371b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:10.795300 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-378113a4-ae2b-404d-913b-fd467d371b74 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1407 microversion: 2.20 time: 0.157742 Sep 27 16:41:10.795858 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 336/642] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:41:10 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:41:11.801223 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-042e1569-bdd7-44bf-8aba-006db9cfdc74 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b186cf2-52c0-437f-aa7f-f7e63901c4e7"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:41:11.803756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-042e1569-bdd7-44bf-8aba-006db9cfdc74 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:11.810892 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-042e1569-bdd7-44bf-8aba-006db9cfdc74 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:11.811521 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-042e1569-bdd7-44bf-8aba-006db9cfdc74 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:11.811952 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-042e1569-bdd7-44bf-8aba-006db9cfdc74 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:11.812645 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-042e1569-bdd7-44bf-8aba-006db9cfdc74 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:11.813446 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-042e1569-bdd7-44bf-8aba-006db9cfdc74 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:11.814131 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-042e1569-bdd7-44bf-8aba-006db9cfdc74 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:11.819052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-eac12811-e847-411e-856c-ba937425cad4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:11.819655 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-eac12811-e847-411e-856c-ba937425cad4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:11.825534 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eac12811-e847-411e-856c-ba937425cad4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:11.826015 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eac12811-e847-411e-856c-ba937425cad4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:11.826450 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eac12811-e847-411e-856c-ba937425cad4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:11.827166 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eac12811-e847-411e-856c-ba937425cad4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:11.827651 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eac12811-e847-411e-856c-ba937425cad4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:11.828074 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eac12811-e847-411e-856c-ba937425cad4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:11.960250 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-eac12811-e847-411e-856c-ba937425cad4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:11.968351 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-eac12811-e847-411e-856c-ba937425cad4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:11.970579 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-eac12811-e847-411e-856c-ba937425cad4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:11.971698 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-eac12811-e847-411e-856c-ba937425cad4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1407 microversion: 2.20 time: 0.156537 Sep 27 16:41:11.972246 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 337/643] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:41:11 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:41:12.965736 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-042e1569-bdd7-44bf-8aba-006db9cfdc74 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "POST /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.168470 Sep 27 16:41:12.966446 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 307/644] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Sep 27 16:41:11 2022] POST /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731/os-volume_attachments => generated 194 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:41:12.996574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-53eca6c5-a03d-43e0-9038-5dc88be61068 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:12.997241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-53eca6c5-a03d-43e0-9038-5dc88be61068 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:13.005699 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-53eca6c5-a03d-43e0-9038-5dc88be61068 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:13.006378 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-53eca6c5-a03d-43e0-9038-5dc88be61068 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:13.007023 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-53eca6c5-a03d-43e0-9038-5dc88be61068 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:13.007945 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-53eca6c5-a03d-43e0-9038-5dc88be61068 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:13.008552 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-53eca6c5-a03d-43e0-9038-5dc88be61068 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:13.009303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-53eca6c5-a03d-43e0-9038-5dc88be61068 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:13.160542 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-53eca6c5-a03d-43e0-9038-5dc88be61068 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:13.168715 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-53eca6c5-a03d-43e0-9038-5dc88be61068 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:13.170177 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-53eca6c5-a03d-43e0-9038-5dc88be61068 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:13.171329 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-53eca6c5-a03d-43e0-9038-5dc88be61068 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1407 microversion: 2.20 time: 0.179175 Sep 27 16:41:13.183354 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 338/645] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:41:12 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:41:14.197914 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6ed1f9eb-ca69-4065-b909-076f6bacda42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:14.198514 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6ed1f9eb-ca69-4065-b909-076f6bacda42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:14.205581 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ed1f9eb-ca69-4065-b909-076f6bacda42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:14.206057 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ed1f9eb-ca69-4065-b909-076f6bacda42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:14.206487 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ed1f9eb-ca69-4065-b909-076f6bacda42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:14.207207 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ed1f9eb-ca69-4065-b909-076f6bacda42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:14.207661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ed1f9eb-ca69-4065-b909-076f6bacda42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:14.208083 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ed1f9eb-ca69-4065-b909-076f6bacda42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:14.335289 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6ed1f9eb-ca69-4065-b909-076f6bacda42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:14.343417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6ed1f9eb-ca69-4065-b909-076f6bacda42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:14.345684 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6ed1f9eb-ca69-4065-b909-076f6bacda42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:14.346799 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6ed1f9eb-ca69-4065-b909-076f6bacda42 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1407 microversion: 2.20 time: 0.153750 Sep 27 16:41:14.347373 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 308/646] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:41:14 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:41:14.850711 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-2eb4014d-733e-4aa8-8686-1bb8066ca7a2 req-1bd9792f-a04b-471d-90d4-9c23e97a37d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac", "name": "network-vif-plugged", "status": "completed", "tag": "ddb6a707-22f0-4c10-adcc-9f4d5d262645"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:41:14.860939 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-2eb4014d-733e-4aa8-8686-1bb8066ca7a2 req-1bd9792f-a04b-471d-90d4-9c23e97a37d2 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:14.861789 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-2eb4014d-733e-4aa8-8686-1bb8066ca7a2 req-1bd9792f-a04b-471d-90d4-9c23e97a37d2 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:14.861919 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-2eb4014d-733e-4aa8-8686-1bb8066ca7a2 req-1bd9792f-a04b-471d-90d4-9c23e97a37d2 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:14.872918 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-2eb4014d-733e-4aa8-8686-1bb8066ca7a2 req-1bd9792f-a04b-471d-90d4-9c23e97a37d2 service nova] Creating event network-vif-plugged:ddb6a707-22f0-4c10-adcc-9f4d5d262645 for instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac on hv-cinder-85506 Sep 27 16:41:14.878515 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-2eb4014d-733e-4aa8-8686-1bb8066ca7a2 req-1bd9792f-a04b-471d-90d4-9c23e97a37d2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031548 Sep 27 16:41:14.879308 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 339/647] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:41:15.371798 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a188a33c-afa5-4bfc-b166-61a6ca183c01 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:15.372340 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a188a33c-afa5-4bfc-b166-61a6ca183c01 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:15.378938 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a188a33c-afa5-4bfc-b166-61a6ca183c01 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:15.379415 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a188a33c-afa5-4bfc-b166-61a6ca183c01 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:15.379847 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a188a33c-afa5-4bfc-b166-61a6ca183c01 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:15.380534 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a188a33c-afa5-4bfc-b166-61a6ca183c01 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:15.380986 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a188a33c-afa5-4bfc-b166-61a6ca183c01 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:15.381403 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a188a33c-afa5-4bfc-b166-61a6ca183c01 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:15.508332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a188a33c-afa5-4bfc-b166-61a6ca183c01 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:15.517253 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a188a33c-afa5-4bfc-b166-61a6ca183c01 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:15.518686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a188a33c-afa5-4bfc-b166-61a6ca183c01 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:15.519805 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a188a33c-afa5-4bfc-b166-61a6ca183c01 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1407 microversion: 2.20 time: 0.152137 Sep 27 16:41:15.520367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 309/648] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:41:15 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:41:15.773330 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a6472b41-7c91-4559-b23b-5d1740dba2aa tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:15.773915 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a6472b41-7c91-4559-b23b-5d1740dba2aa tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:15.775841 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:15.780688 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6472b41-7c91-4559-b23b-5d1740dba2aa tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:15.781171 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6472b41-7c91-4559-b23b-5d1740dba2aa tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:15.782555 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6472b41-7c91-4559-b23b-5d1740dba2aa tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:15.783247 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6472b41-7c91-4559-b23b-5d1740dba2aa tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:15.783706 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6472b41-7c91-4559-b23b-5d1740dba2aa tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:15.789153 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6472b41-7c91-4559-b23b-5d1740dba2aa tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:15.866092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-a6472b41-7c91-4559-b23b-5d1740dba2aa tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lazy-loading 'services' on Instance uuid 917a245d-3957-45a3-a011-67b79c56ea0a {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:41:16.018726 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a6472b41-7c91-4559-b23b-5d1740dba2aa tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "DELETE /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a/os-volume_attachments/7ad36316-aad1-4870-96f6-6e46b6884103" status: 202 len: 0 microversion: 2.1 time: 0.249132 Sep 27 16:41:16.019287 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 340/649] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Sep 27 16:41:15 2022] DELETE /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a/os-volume_attachments/7ad36316-aad1-4870-96f6-6e46b6884103 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:41:16.544843 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-07ee613c-c31f-44d3-a812-dc8ccc42f946 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:16.545447 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-07ee613c-c31f-44d3-a812-dc8ccc42f946 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:16.552524 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07ee613c-c31f-44d3-a812-dc8ccc42f946 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:16.552972 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07ee613c-c31f-44d3-a812-dc8ccc42f946 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:16.553401 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07ee613c-c31f-44d3-a812-dc8ccc42f946 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:16.554123 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07ee613c-c31f-44d3-a812-dc8ccc42f946 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:16.554573 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07ee613c-c31f-44d3-a812-dc8ccc42f946 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:16.555014 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07ee613c-c31f-44d3-a812-dc8ccc42f946 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:16.688327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-07ee613c-c31f-44d3-a812-dc8ccc42f946 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:16.696691 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-07ee613c-c31f-44d3-a812-dc8ccc42f946 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:16.698133 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-07ee613c-c31f-44d3-a812-dc8ccc42f946 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:16.699258 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-07ee613c-c31f-44d3-a812-dc8ccc42f946 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1407 microversion: 2.20 time: 0.158324 Sep 27 16:41:16.699820 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 310/650] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:41:16 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:41:17.726049 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2e87e6cf-98bf-4ff7-a76d-0a41d99d9034 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:17.726900 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2e87e6cf-98bf-4ff7-a76d-0a41d99d9034 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:17.733263 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2e87e6cf-98bf-4ff7-a76d-0a41d99d9034 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:17.733749 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2e87e6cf-98bf-4ff7-a76d-0a41d99d9034 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:17.734187 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2e87e6cf-98bf-4ff7-a76d-0a41d99d9034 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:17.734900 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2e87e6cf-98bf-4ff7-a76d-0a41d99d9034 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:17.735357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2e87e6cf-98bf-4ff7-a76d-0a41d99d9034 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:17.735782 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2e87e6cf-98bf-4ff7-a76d-0a41d99d9034 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:17.867209 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2e87e6cf-98bf-4ff7-a76d-0a41d99d9034 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:17.875331 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2e87e6cf-98bf-4ff7-a76d-0a41d99d9034 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:17.876773 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2e87e6cf-98bf-4ff7-a76d-0a41d99d9034 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:17.878719 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2e87e6cf-98bf-4ff7-a76d-0a41d99d9034 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1600 microversion: 2.20 time: 0.156989 Sep 27 16:41:17.879380 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 341/651] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:41:17 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:41:17.902863 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4599136d-d828-4b7f-b863-abc6744f1d50 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:17.903383 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4599136d-d828-4b7f-b863-abc6744f1d50 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:17.909998 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4599136d-d828-4b7f-b863-abc6744f1d50 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:17.910478 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4599136d-d828-4b7f-b863-abc6744f1d50 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:17.910949 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4599136d-d828-4b7f-b863-abc6744f1d50 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:17.911636 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4599136d-d828-4b7f-b863-abc6744f1d50 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:17.912086 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4599136d-d828-4b7f-b863-abc6744f1d50 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:17.912506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4599136d-d828-4b7f-b863-abc6744f1d50 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:17.929402 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:17.989134 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4599136d-d828-4b7f-b863-abc6744f1d50 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090098 Sep 27 16:41:17.989721 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 311/652] 10.222.0.64 () {60 vars in 1316 bytes} [Tue Sep 27 16:41:17 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 16:41:18.982093 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-c9c751d5-0b93-4b4a-a6a7-19404c793bd6 req-6f7a8176-0f0c-45bb-9b89-42b86570a80f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac", "tag": "ddb6a707-22f0-4c10-adcc-9f4d5d262645"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:41:18.992456 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-c9c751d5-0b93-4b4a-a6a7-19404c793bd6 req-6f7a8176-0f0c-45bb-9b89-42b86570a80f service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:18.993070 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-c9c751d5-0b93-4b4a-a6a7-19404c793bd6 req-6f7a8176-0f0c-45bb-9b89-42b86570a80f service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:18.993572 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-c9c751d5-0b93-4b4a-a6a7-19404c793bd6 req-6f7a8176-0f0c-45bb-9b89-42b86570a80f service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:19.004627 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-c9c751d5-0b93-4b4a-a6a7-19404c793bd6 req-6f7a8176-0f0c-45bb-9b89-42b86570a80f service nova] Creating event network-changed:ddb6a707-22f0-4c10-adcc-9f4d5d262645 for instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac on hv-cinder-85506 Sep 27 16:41:19.009675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-c9c751d5-0b93-4b4a-a6a7-19404c793bd6 req-6f7a8176-0f0c-45bb-9b89-42b86570a80f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031372 Sep 27 16:41:19.010376 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 342/653] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:41:20.521072 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1d9c6c57-57ea-4ed2-ad82-780466dd2fd6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:41:20.523519 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1d9c6c57-57ea-4ed2-ad82-780466dd2fd6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:20.532195 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d9c6c57-57ea-4ed2-ad82-780466dd2fd6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:20.532682 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d9c6c57-57ea-4ed2-ad82-780466dd2fd6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:20.533118 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d9c6c57-57ea-4ed2-ad82-780466dd2fd6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:20.534327 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d9c6c57-57ea-4ed2-ad82-780466dd2fd6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:20.534891 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d9c6c57-57ea-4ed2-ad82-780466dd2fd6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:20.535457 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d9c6c57-57ea-4ed2-ad82-780466dd2fd6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:20.563243 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-1d9c6c57-57ea-4ed2-ad82-780466dd2fd6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lazy-loading 'flavor' on Instance uuid 18c68417-b41c-4ab3-9fac-9e7087bfe731 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:41:20.812635 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1d9c6c57-57ea-4ed2-ad82-780466dd2fd6 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "POST /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731/action" status: 200 len: 32 microversion: 2.1 time: 0.296286 Sep 27 16:41:20.813429 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 312/654] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Sep 27 16:41:20 2022] POST /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731/action => generated 32 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 16:41:20.824122 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-89a8dd5e-8ccc-4353-b462-282fd84445d1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:20.824820 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-89a8dd5e-8ccc-4353-b462-282fd84445d1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:20.830998 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-89a8dd5e-8ccc-4353-b462-282fd84445d1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:20.832021 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-89a8dd5e-8ccc-4353-b462-282fd84445d1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:20.832459 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-89a8dd5e-8ccc-4353-b462-282fd84445d1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:20.833156 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-89a8dd5e-8ccc-4353-b462-282fd84445d1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:20.833604 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-89a8dd5e-8ccc-4353-b462-282fd84445d1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:20.834026 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-89a8dd5e-8ccc-4353-b462-282fd84445d1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:20.852815 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:20.973907 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-89a8dd5e-8ccc-4353-b462-282fd84445d1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:20.982379 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-89a8dd5e-8ccc-4353-b462-282fd84445d1 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1733 microversion: 2.1 time: 0.162637 Sep 27 16:41:20.986371 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 343/655] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:20 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:21.384527 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f6d7e4db-0d95-4d2f-8a05-8ea0c7cc951d tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:21.385479 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f6d7e4db-0d95-4d2f-8a05-8ea0c7cc951d tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:21.391775 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f6d7e4db-0d95-4d2f-8a05-8ea0c7cc951d tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:21.392325 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f6d7e4db-0d95-4d2f-8a05-8ea0c7cc951d tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:21.392710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f6d7e4db-0d95-4d2f-8a05-8ea0c7cc951d tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:21.393441 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f6d7e4db-0d95-4d2f-8a05-8ea0c7cc951d tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:21.393956 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f6d7e4db-0d95-4d2f-8a05-8ea0c7cc951d tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:21.394600 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f6d7e4db-0d95-4d2f-8a05-8ea0c7cc951d tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:21.423394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f6d7e4db-0d95-4d2f-8a05-8ea0c7cc951d tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 16:41:21.721437 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f6d7e4db-0d95-4d2f-8a05-8ea0c7cc951d tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "DELETE /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a" status: 204 len: 0 microversion: 2.1 time: 0.340948 Sep 27 16:41:21.722625 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 313/656] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:41:21 2022] DELETE /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 16:41:21.730811 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bebdf655-3d2e-4932-a171-63e3825589c8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:21.731555 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bebdf655-3d2e-4932-a171-63e3825589c8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:21.737682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bebdf655-3d2e-4932-a171-63e3825589c8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:21.738171 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bebdf655-3d2e-4932-a171-63e3825589c8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:21.738608 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bebdf655-3d2e-4932-a171-63e3825589c8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:21.739334 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bebdf655-3d2e-4932-a171-63e3825589c8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:21.739791 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bebdf655-3d2e-4932-a171-63e3825589c8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:21.740218 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bebdf655-3d2e-4932-a171-63e3825589c8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:21.869249 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bebdf655-3d2e-4932-a171-63e3825589c8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:21.877079 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bebdf655-3d2e-4932-a171-63e3825589c8 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a" status: 200 len: 1514 microversion: 2.1 time: 0.150046 Sep 27 16:41:21.877641 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 344/657] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:21 2022] GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:22.007185 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c0cc9597-29a6-47e1-a1d7-45ee7f97e078 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:22.007808 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c0cc9597-29a6-47e1-a1d7-45ee7f97e078 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:22.013690 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c0cc9597-29a6-47e1-a1d7-45ee7f97e078 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:22.014167 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c0cc9597-29a6-47e1-a1d7-45ee7f97e078 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:22.014595 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c0cc9597-29a6-47e1-a1d7-45ee7f97e078 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:22.015313 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c0cc9597-29a6-47e1-a1d7-45ee7f97e078 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:22.015757 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c0cc9597-29a6-47e1-a1d7-45ee7f97e078 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:22.016172 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c0cc9597-29a6-47e1-a1d7-45ee7f97e078 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:22.146757 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c0cc9597-29a6-47e1-a1d7-45ee7f97e078 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:22.155114 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c0cc9597-29a6-47e1-a1d7-45ee7f97e078 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1733 microversion: 2.1 time: 0.153098 Sep 27 16:41:22.155689 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 314/658] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:22 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:22.899510 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9a33b147-e1f7-49f7-9a10-b656060201c4 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:22.900099 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9a33b147-e1f7-49f7-9a10-b656060201c4 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:22.906231 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a33b147-e1f7-49f7-9a10-b656060201c4 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:22.906711 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a33b147-e1f7-49f7-9a10-b656060201c4 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:22.907431 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a33b147-e1f7-49f7-9a10-b656060201c4 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:22.908113 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a33b147-e1f7-49f7-9a10-b656060201c4 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:22.908564 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a33b147-e1f7-49f7-9a10-b656060201c4 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:22.908983 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9a33b147-e1f7-49f7-9a10-b656060201c4 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:23.037570 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9a33b147-e1f7-49f7-9a10-b656060201c4 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:23.045161 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9a33b147-e1f7-49f7-9a10-b656060201c4 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a" status: 200 len: 1514 microversion: 2.1 time: 0.149562 Sep 27 16:41:23.045717 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 345/659] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:22 2022] GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:23.178337 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-28c61c61-1a03-404d-a32a-b4a9a9756dd9 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:23.178908 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-28c61c61-1a03-404d-a32a-b4a9a9756dd9 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:23.181320 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:23.186003 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28c61c61-1a03-404d-a32a-b4a9a9756dd9 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:23.186484 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28c61c61-1a03-404d-a32a-b4a9a9756dd9 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:23.186958 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28c61c61-1a03-404d-a32a-b4a9a9756dd9 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:23.187649 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28c61c61-1a03-404d-a32a-b4a9a9756dd9 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:23.188100 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28c61c61-1a03-404d-a32a-b4a9a9756dd9 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:23.188521 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28c61c61-1a03-404d-a32a-b4a9a9756dd9 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:23.318555 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-28c61c61-1a03-404d-a32a-b4a9a9756dd9 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:23.326665 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-28c61c61-1a03-404d-a32a-b4a9a9756dd9 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1733 microversion: 2.1 time: 0.152261 Sep 27 16:41:23.327268 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 315/660] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:23 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:24.068756 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5cceab27-55a9-429a-ac3d-ccdcdee0cb38 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:24.069372 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5cceab27-55a9-429a-ac3d-ccdcdee0cb38 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:24.077527 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5cceab27-55a9-429a-ac3d-ccdcdee0cb38 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:24.078094 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5cceab27-55a9-429a-ac3d-ccdcdee0cb38 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:24.079070 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5cceab27-55a9-429a-ac3d-ccdcdee0cb38 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:24.080137 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5cceab27-55a9-429a-ac3d-ccdcdee0cb38 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:24.080664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5cceab27-55a9-429a-ac3d-ccdcdee0cb38 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:24.081786 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5cceab27-55a9-429a-ac3d-ccdcdee0cb38 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:24.161415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5cceab27-55a9-429a-ac3d-ccdcdee0cb38 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:24.163506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-c3570837-2c01-4396-bee3-9392491e93b0 req-ffc24936-dedb-4276-9fc0-9734c001e492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "917a245d-3957-45a3-a011-67b79c56ea0a", "name": "network-vif-deleted", "tag": "22b2a016-09d8-4486-8dd8-f824c8714bbe"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:41:24.172915 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-c3570837-2c01-4396-bee3-9392491e93b0 req-ffc24936-dedb-4276-9fc0-9734c001e492 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:24.173398 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-c3570837-2c01-4396-bee3-9392491e93b0 req-ffc24936-dedb-4276-9fc0-9734c001e492 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:24.173582 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5cceab27-55a9-429a-ac3d-ccdcdee0cb38 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a" status: 200 len: 1472 microversion: 2.1 time: 0.109641 Sep 27 16:41:24.173827 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-c3570837-2c01-4396-bee3-9392491e93b0 req-ffc24936-dedb-4276-9fc0-9734c001e492 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:24.174402 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 346/661] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:24 2022] GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a => generated 1472 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:24.186685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-c3570837-2c01-4396-bee3-9392491e93b0 req-ffc24936-dedb-4276-9fc0-9734c001e492 service nova] Creating event network-vif-deleted:22b2a016-09d8-4486-8dd8-f824c8714bbe for instance 917a245d-3957-45a3-a011-67b79c56ea0a on hv-cinder-85506 Sep 27 16:41:24.191910 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-c3570837-2c01-4396-bee3-9392491e93b0 req-ffc24936-dedb-4276-9fc0-9734c001e492 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035271 Sep 27 16:41:24.192526 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 316/662] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:41:24.350281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3e971634-6029-4d80-8afb-cca43df9ab8b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:24.350995 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3e971634-6029-4d80-8afb-cca43df9ab8b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:24.361348 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e971634-6029-4d80-8afb-cca43df9ab8b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:24.361348 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e971634-6029-4d80-8afb-cca43df9ab8b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:24.361348 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e971634-6029-4d80-8afb-cca43df9ab8b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:24.361348 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e971634-6029-4d80-8afb-cca43df9ab8b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:24.361731 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e971634-6029-4d80-8afb-cca43df9ab8b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:24.361731 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e971634-6029-4d80-8afb-cca43df9ab8b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:24.505991 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3e971634-6029-4d80-8afb-cca43df9ab8b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:24.515737 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3e971634-6029-4d80-8afb-cca43df9ab8b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1733 microversion: 2.1 time: 0.169792 Sep 27 16:41:24.516309 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 347/663] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:24 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:25.198804 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2acec51a-8b6b-420f-aec8-97494cb24a56 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:25.199532 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2acec51a-8b6b-420f-aec8-97494cb24a56 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:25.205540 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2acec51a-8b6b-420f-aec8-97494cb24a56 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:25.220696 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2acec51a-8b6b-420f-aec8-97494cb24a56 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:25.220696 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2acec51a-8b6b-420f-aec8-97494cb24a56 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:25.220696 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2acec51a-8b6b-420f-aec8-97494cb24a56 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:25.220696 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2acec51a-8b6b-420f-aec8-97494cb24a56 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:25.221098 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2acec51a-8b6b-420f-aec8-97494cb24a56 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:25.239234 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2acec51a-8b6b-420f-aec8-97494cb24a56 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:25.239715 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2acec51a-8b6b-420f-aec8-97494cb24a56 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:25.240146 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2acec51a-8b6b-420f-aec8-97494cb24a56 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:25.240588 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-2acec51a-8b6b-420f-aec8-97494cb24a56 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lazy-loading 'fault' on Instance uuid 917a245d-3957-45a3-a011-67b79c56ea0a {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:41:25.395798 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2acec51a-8b6b-420f-aec8-97494cb24a56 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211efc6d124344c0b6ba83c378425df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a06947e0733946bb8e266382c0d4d0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:25.403498 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2acec51a-8b6b-420f-aec8-97494cb24a56 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a" status: 200 len: 1309 microversion: 2.1 time: 0.209457 Sep 27 16:41:25.406395 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 317/664] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:25 2022] GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a => generated 1309 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:25.540821 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fa5f9a88-dfaf-4b26-aa4f-049044db285c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:25.541366 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fa5f9a88-dfaf-4b26-aa4f-049044db285c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:25.547159 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa5f9a88-dfaf-4b26-aa4f-049044db285c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:25.547636 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa5f9a88-dfaf-4b26-aa4f-049044db285c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:25.548063 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa5f9a88-dfaf-4b26-aa4f-049044db285c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:25.548742 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa5f9a88-dfaf-4b26-aa4f-049044db285c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:25.549193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa5f9a88-dfaf-4b26-aa4f-049044db285c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:25.549612 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa5f9a88-dfaf-4b26-aa4f-049044db285c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:25.681325 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fa5f9a88-dfaf-4b26-aa4f-049044db285c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:25.689376 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fa5f9a88-dfaf-4b26-aa4f-049044db285c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1733 microversion: 2.1 time: 0.152495 Sep 27 16:41:25.692789 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 348/665] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:25 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:26.427430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5d05df4a-c96f-4a5b-8d7b-dbc4f3790233 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:26.428027 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5d05df4a-c96f-4a5b-8d7b-dbc4f3790233 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] [instance: 917a245d-3957-45a3-a011-67b79c56ea0a] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:26.434386 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5d05df4a-c96f-4a5b-8d7b-dbc4f3790233 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:26.434891 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5d05df4a-c96f-4a5b-8d7b-dbc4f3790233 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:26.435346 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5d05df4a-c96f-4a5b-8d7b-dbc4f3790233 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:26.436024 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5d05df4a-c96f-4a5b-8d7b-dbc4f3790233 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:26.436473 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5d05df4a-c96f-4a5b-8d7b-dbc4f3790233 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:26.436889 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5d05df4a-c96f-4a5b-8d7b-dbc4f3790233 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:26.450468 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-5d05df4a-c96f-4a5b-8d7b-dbc4f3790233 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] HTTP exception thrown: Instance 917a245d-3957-45a3-a011-67b79c56ea0a could not be found. Sep 27 16:41:26.452091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5d05df4a-c96f-4a5b-8d7b-dbc4f3790233 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Request method failure captured: Sep 27 16:41:26.452091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a HTTP/1.1 Sep 27 16:41:26.452091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:41:26.452091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:41:26.452091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:41:26.452091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 27 16:41:26.452091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:41:26.452091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:41:26.452091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:41:26.452091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:41:26.452091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMycLxVj26daLJJOzcGppVjF9xxPXwFfxAEvhBgk6NlRvcnzna241lO0RmFYfRMdEQfA6pxoOKjAGD5tW8jWeWMnkPElZAYQ9K72-5-QAZqWuiaqcY5zPQKm9xxr2UHxKUOatrax5V5nDgEuM9diq-vZiUgKB6tSuM9dGsbQ-2gtUAgQ Sep 27 16:41:26.452091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:41:26.452091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:41:26.452091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:41:26.452091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:41:26.452091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:41:26.452091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:41:26.452091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: a06947e0733946bb8e266382c0d4d0ce Sep 27 16:41:26.452091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesSnapshotTestJSON-781298834 Sep 27 16:41:26.452091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:41:26.452091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:41:26.453754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a06947e0733946bb8e266382c0d4d0ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a06947e0733946bb8e266382c0d4d0ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a06947e0733946bb8e266382c0d4d0ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a06947e0733946bb8e266382c0d4d0ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:41:26.453754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesSnapshotTestJSON-781298834 Sep 27 16:41:26.453754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: a06947e0733946bb8e266382c0d4d0ce Sep 27 16:41:26.453754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-781298834 Sep 27 16:41:26.453754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesSnapshotTestJSON-781298834-project Sep 27 16:41:26.453754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:41:26.453754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:41:26.453754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: 211efc6d124344c0b6ba83c378425df0 Sep 27 16:41:26.453754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesSnapshotTestJSON-781298834-project Sep 27 16:41:26.453754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: > Sep 27 16:41:26.453754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Instance 917a245d-3957-45a3-a011-67b79c56ea0a could not be found. Sep 27 16:41:26.453754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'id': '917a245d-3957-45a3-a011-67b79c56ea0a'} Sep 27 16:41:26.454747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:41:26.454747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:41:26.454747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:41:26.454747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:41:26.454747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:41:26.454747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:41:26.454747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:41:26.454747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:41:26.454747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:41:26.454747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:41:26.454747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 917a245d-3957-45a3-a011-67b79c56ea0a could not be found. Sep 27 16:41:26.454747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:41:26.454747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:41:26.454747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:41:26.454747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:41:26.454747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:41:26.454747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:41:26.454747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:41:26.454747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:41:26.454747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:41:26.457152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:41:26.457152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:41:26.457152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:41:26.457152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:41:26.457152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:41:26.457152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:41:26.457152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:41:26.457152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 917a245d-3957-45a3-a011-67b79c56ea0a could not be found. Sep 27 16:41:26.457152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:41:26.457152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:41:26.457152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:41:26.457152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:41:26.457152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:41:26.457152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:41:26.457152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:41:26.457152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:41:26.457152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 917a245d-3957-45a3-a011-67b79c56ea0a could not be found. Sep 27 16:41:26.457152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:41:26.458557 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5d05df4a-c96f-4a5b-8d7b-dbc4f3790233 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] Returning 404 to user: Instance 917a245d-3957-45a3-a011-67b79c56ea0a could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:41:26.458557 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5d05df4a-c96f-4a5b-8d7b-dbc4f3790233 tempest-VolumesSnapshotTestJSON-781298834 tempest-VolumesSnapshotTestJSON-781298834-project] 10.222.0.64 "GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a" status: 404 len: 111 microversion: 2.1 time: 0.029979 Sep 27 16:41:26.458557 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 318/666] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:26 2022] GET /compute/v2.1/servers/917a245d-3957-45a3-a011-67b79c56ea0a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:41:26.712359 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8e332293-9e7f-46e0-9abe-112a014af3f5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:26.713119 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8e332293-9e7f-46e0-9abe-112a014af3f5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:26.719578 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e332293-9e7f-46e0-9abe-112a014af3f5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:26.720058 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e332293-9e7f-46e0-9abe-112a014af3f5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:26.720496 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e332293-9e7f-46e0-9abe-112a014af3f5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:26.721195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e332293-9e7f-46e0-9abe-112a014af3f5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:26.721703 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e332293-9e7f-46e0-9abe-112a014af3f5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:26.722132 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e332293-9e7f-46e0-9abe-112a014af3f5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:26.858589 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8e332293-9e7f-46e0-9abe-112a014af3f5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:26.867584 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8e332293-9e7f-46e0-9abe-112a014af3f5 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1733 microversion: 2.1 time: 0.159156 Sep 27 16:41:26.868149 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 349/667] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:26 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:27.891186 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e4e57cd0-b79c-4741-a049-b2e36e8aac76 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:27.891795 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e4e57cd0-b79c-4741-a049-b2e36e8aac76 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:27.898276 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4e57cd0-b79c-4741-a049-b2e36e8aac76 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:27.898756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4e57cd0-b79c-4741-a049-b2e36e8aac76 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:27.899212 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4e57cd0-b79c-4741-a049-b2e36e8aac76 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:27.899895 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4e57cd0-b79c-4741-a049-b2e36e8aac76 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:27.900348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4e57cd0-b79c-4741-a049-b2e36e8aac76 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:27.900769 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4e57cd0-b79c-4741-a049-b2e36e8aac76 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:28.030008 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e4e57cd0-b79c-4741-a049-b2e36e8aac76 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:28.039730 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e4e57cd0-b79c-4741-a049-b2e36e8aac76 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1733 microversion: 2.1 time: 0.152339 Sep 27 16:41:28.040308 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 319/668] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:27 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:29.063725 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ecb558b4-a732-4c67-bcc3-79640634e3fb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:29.064342 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ecb558b4-a732-4c67-bcc3-79640634e3fb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:29.071379 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecb558b4-a732-4c67-bcc3-79640634e3fb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:29.071870 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecb558b4-a732-4c67-bcc3-79640634e3fb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:29.072302 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecb558b4-a732-4c67-bcc3-79640634e3fb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:29.072988 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecb558b4-a732-4c67-bcc3-79640634e3fb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:29.073533 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecb558b4-a732-4c67-bcc3-79640634e3fb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:29.073954 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecb558b4-a732-4c67-bcc3-79640634e3fb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:29.260124 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ecb558b4-a732-4c67-bcc3-79640634e3fb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:29.268451 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ecb558b4-a732-4c67-bcc3-79640634e3fb tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1733 microversion: 2.1 time: 0.208721 Sep 27 16:41:29.270889 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 350/669] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:29 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1733 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:30.293982 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b607419d-4d4d-45e2-b72c-abc79a5b1948 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:30.294591 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b607419d-4d4d-45e2-b72c-abc79a5b1948 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:30.301865 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b607419d-4d4d-45e2-b72c-abc79a5b1948 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:30.302340 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b607419d-4d4d-45e2-b72c-abc79a5b1948 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:30.302764 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b607419d-4d4d-45e2-b72c-abc79a5b1948 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:30.303468 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b607419d-4d4d-45e2-b72c-abc79a5b1948 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:30.303941 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b607419d-4d4d-45e2-b72c-abc79a5b1948 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:30.304358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b607419d-4d4d-45e2-b72c-abc79a5b1948 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:30.433410 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b607419d-4d4d-45e2-b72c-abc79a5b1948 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:30.442645 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b607419d-4d4d-45e2-b72c-abc79a5b1948 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1733 microversion: 2.1 time: 0.152532 Sep 27 16:41:30.443557 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 320/670] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:30 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:31.466405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-588a5478-ae20-4fbb-878b-38bd33efa7c8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:31.467618 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-588a5478-ae20-4fbb-878b-38bd33efa7c8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:31.474209 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-588a5478-ae20-4fbb-878b-38bd33efa7c8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:31.474978 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-588a5478-ae20-4fbb-878b-38bd33efa7c8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:31.475415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-588a5478-ae20-4fbb-878b-38bd33efa7c8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:31.476296 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-588a5478-ae20-4fbb-878b-38bd33efa7c8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:31.476754 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-588a5478-ae20-4fbb-878b-38bd33efa7c8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:31.477179 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-588a5478-ae20-4fbb-878b-38bd33efa7c8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:31.616504 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-588a5478-ae20-4fbb-878b-38bd33efa7c8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:31.624689 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-588a5478-ae20-4fbb-878b-38bd33efa7c8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1733 microversion: 2.1 time: 0.162071 Sep 27 16:41:31.625246 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 351/671] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:31 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:32.648674 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2558a810-7d24-4b5a-bcf1-3a8e0a15095c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:32.649272 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2558a810-7d24-4b5a-bcf1-3a8e0a15095c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:32.655968 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2558a810-7d24-4b5a-bcf1-3a8e0a15095c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:32.656438 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2558a810-7d24-4b5a-bcf1-3a8e0a15095c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:32.657114 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2558a810-7d24-4b5a-bcf1-3a8e0a15095c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:32.657789 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2558a810-7d24-4b5a-bcf1-3a8e0a15095c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:32.658234 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2558a810-7d24-4b5a-bcf1-3a8e0a15095c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:32.658645 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2558a810-7d24-4b5a-bcf1-3a8e0a15095c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:32.787690 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2558a810-7d24-4b5a-bcf1-3a8e0a15095c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:32.795828 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2558a810-7d24-4b5a-bcf1-3a8e0a15095c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1733 microversion: 2.1 time: 0.150910 Sep 27 16:41:32.796393 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 321/672] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:32 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:33.820080 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-967f33bd-ab8f-4b7b-a5c6-5b6bd7222c17 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:33.820700 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-967f33bd-ab8f-4b7b-a5c6-5b6bd7222c17 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:33.826639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-967f33bd-ab8f-4b7b-a5c6-5b6bd7222c17 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:33.827154 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-967f33bd-ab8f-4b7b-a5c6-5b6bd7222c17 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:33.827689 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-967f33bd-ab8f-4b7b-a5c6-5b6bd7222c17 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:33.828373 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-967f33bd-ab8f-4b7b-a5c6-5b6bd7222c17 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:33.828918 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-967f33bd-ab8f-4b7b-a5c6-5b6bd7222c17 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:33.829339 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-967f33bd-ab8f-4b7b-a5c6-5b6bd7222c17 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:33.960656 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-967f33bd-ab8f-4b7b-a5c6-5b6bd7222c17 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:33.968888 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-967f33bd-ab8f-4b7b-a5c6-5b6bd7222c17 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1733 microversion: 2.1 time: 0.153461 Sep 27 16:41:33.969452 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 352/673] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:33 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:34.992524 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4a21a1e8-2a31-4930-ba96-819d2b68ce8d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:34.993125 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4a21a1e8-2a31-4930-ba96-819d2b68ce8d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:34.999463 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4a21a1e8-2a31-4930-ba96-819d2b68ce8d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:34.999940 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4a21a1e8-2a31-4930-ba96-819d2b68ce8d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:35.000363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4a21a1e8-2a31-4930-ba96-819d2b68ce8d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:35.001039 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4a21a1e8-2a31-4930-ba96-819d2b68ce8d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:35.001483 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4a21a1e8-2a31-4930-ba96-819d2b68ce8d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:35.001896 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4a21a1e8-2a31-4930-ba96-819d2b68ce8d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:35.128445 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4a21a1e8-2a31-4930-ba96-819d2b68ce8d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:35.136529 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4a21a1e8-2a31-4930-ba96-819d2b68ce8d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1733 microversion: 2.1 time: 0.148150 Sep 27 16:41:35.137094 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 322/674] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:34 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:41:36.160403 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fb5685f0-8d2f-40ee-87d6-e7dc289bafcf tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:36.160938 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fb5685f0-8d2f-40ee-87d6-e7dc289bafcf tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:36.167188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb5685f0-8d2f-40ee-87d6-e7dc289bafcf tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:36.167677 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb5685f0-8d2f-40ee-87d6-e7dc289bafcf tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:36.168117 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb5685f0-8d2f-40ee-87d6-e7dc289bafcf tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:36.168807 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb5685f0-8d2f-40ee-87d6-e7dc289bafcf tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:36.169263 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb5685f0-8d2f-40ee-87d6-e7dc289bafcf tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:36.169690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb5685f0-8d2f-40ee-87d6-e7dc289bafcf tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:36.298257 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fb5685f0-8d2f-40ee-87d6-e7dc289bafcf tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:36.306974 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fb5685f0-8d2f-40ee-87d6-e7dc289bafcf tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1733 microversion: 2.1 time: 0.150762 Sep 27 16:41:36.307413 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 353/675] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:36 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:36.327812 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-75fa4f8e-79e1-4c81-bab5-89c6cee53296 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:36.328394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-75fa4f8e-79e1-4c81-bab5-89c6cee53296 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:36.335801 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-75fa4f8e-79e1-4c81-bab5-89c6cee53296 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:36.336466 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-75fa4f8e-79e1-4c81-bab5-89c6cee53296 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:36.336900 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-75fa4f8e-79e1-4c81-bab5-89c6cee53296 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:36.341354 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-75fa4f8e-79e1-4c81-bab5-89c6cee53296 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:36.341354 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-75fa4f8e-79e1-4c81-bab5-89c6cee53296 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:36.341354 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-75fa4f8e-79e1-4c81-bab5-89c6cee53296 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:36.361411 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-75fa4f8e-79e1-4c81-bab5-89c6cee53296 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700/ips" status: 200 len: 149 microversion: 2.1 time: 0.037654 Sep 27 16:41:36.361970 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 323/676] 10.222.0.64 () {58 vars in 1248 bytes} [Tue Sep 27 16:41:36 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:41:37.334192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ffe8302f-2f2d-4374-a885-433771a50d6a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:37.334865 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ffe8302f-2f2d-4374-a885-433771a50d6a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:37.341005 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ffe8302f-2f2d-4374-a885-433771a50d6a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:37.341494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ffe8302f-2f2d-4374-a885-433771a50d6a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:37.341924 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ffe8302f-2f2d-4374-a885-433771a50d6a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:37.342629 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ffe8302f-2f2d-4374-a885-433771a50d6a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:37.343125 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ffe8302f-2f2d-4374-a885-433771a50d6a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:37.343548 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ffe8302f-2f2d-4374-a885-433771a50d6a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:37.480110 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ffe8302f-2f2d-4374-a885-433771a50d6a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:37.488828 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ffe8302f-2f2d-4374-a885-433771a50d6a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1733 microversion: 2.1 time: 0.158925 Sep 27 16:41:37.489173 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 354/677] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:37 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:38.008142 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8cfe3c5b-1219-404b-af51-0f1c06f9bcf8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "189cd509-47f5-49af-94e7-57f5d3fdaf40"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:41:38.010457 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8cfe3c5b-1219-404b-af51-0f1c06f9bcf8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:38.016856 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8cfe3c5b-1219-404b-af51-0f1c06f9bcf8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:38.017335 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8cfe3c5b-1219-404b-af51-0f1c06f9bcf8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:38.017765 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8cfe3c5b-1219-404b-af51-0f1c06f9bcf8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:38.018443 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8cfe3c5b-1219-404b-af51-0f1c06f9bcf8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:38.018919 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8cfe3c5b-1219-404b-af51-0f1c06f9bcf8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:38.019336 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8cfe3c5b-1219-404b-af51-0f1c06f9bcf8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:38.514961 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-56b5c24c-e1a9-49f1-bb4f-33367c357619 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:38.515576 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-56b5c24c-e1a9-49f1-bb4f-33367c357619 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:38.522133 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-56b5c24c-e1a9-49f1-bb4f-33367c357619 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:38.522622 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-56b5c24c-e1a9-49f1-bb4f-33367c357619 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:38.523093 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-56b5c24c-e1a9-49f1-bb4f-33367c357619 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:38.523815 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-56b5c24c-e1a9-49f1-bb4f-33367c357619 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:38.524268 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-56b5c24c-e1a9-49f1-bb4f-33367c357619 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:38.524695 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-56b5c24c-e1a9-49f1-bb4f-33367c357619 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:38.649893 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-56b5c24c-e1a9-49f1-bb4f-33367c357619 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:38.658238 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-56b5c24c-e1a9-49f1-bb4f-33367c357619 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1733 microversion: 2.1 time: 0.147127 Sep 27 16:41:38.658812 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 355/678] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:38 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:41:39.681819 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-130d791a-114f-45f3-a690-56c6d1df608c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:39.682427 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-130d791a-114f-45f3-a690-56c6d1df608c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:39.688745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-130d791a-114f-45f3-a690-56c6d1df608c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:39.689235 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-130d791a-114f-45f3-a690-56c6d1df608c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:39.689677 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-130d791a-114f-45f3-a690-56c6d1df608c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:39.690399 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-130d791a-114f-45f3-a690-56c6d1df608c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:39.690914 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-130d791a-114f-45f3-a690-56c6d1df608c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:39.692522 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-130d791a-114f-45f3-a690-56c6d1df608c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:39.826068 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-130d791a-114f-45f3-a690-56c6d1df608c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:39.834799 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-130d791a-114f-45f3-a690-56c6d1df608c tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1733 microversion: 2.1 time: 0.156921 Sep 27 16:41:39.835369 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 356/679] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:39 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:40.857506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ffec1145-fa13-409e-a88f-a6556a9a9d77 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:40.858167 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ffec1145-fa13-409e-a88f-a6556a9a9d77 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:40.864773 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ffec1145-fa13-409e-a88f-a6556a9a9d77 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:40.865572 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ffec1145-fa13-409e-a88f-a6556a9a9d77 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:40.866023 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ffec1145-fa13-409e-a88f-a6556a9a9d77 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:40.866728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ffec1145-fa13-409e-a88f-a6556a9a9d77 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:40.867223 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ffec1145-fa13-409e-a88f-a6556a9a9d77 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:40.867700 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ffec1145-fa13-409e-a88f-a6556a9a9d77 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:40.995347 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ffec1145-fa13-409e-a88f-a6556a9a9d77 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:41.003607 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ffec1145-fa13-409e-a88f-a6556a9a9d77 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1733 microversion: 2.1 time: 0.150077 Sep 27 16:41:41.005292 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 357/680] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:40 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:41:41.099903 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:41.205531 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8cfe3c5b-1219-404b-af51-0f1c06f9bcf8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "POST /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.201004 Sep 27 16:41:41.206100 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 324/681] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Sep 27 16:41:38 2022] POST /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700/os-volume_attachments => generated 194 bytes in 3203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:41:42.027537 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a6a474c5-1f20-4290-9f42-b4b976c6a0a7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:42.029297 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a6a474c5-1f20-4290-9f42-b4b976c6a0a7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:42.036388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6a474c5-1f20-4290-9f42-b4b976c6a0a7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:42.036881 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6a474c5-1f20-4290-9f42-b4b976c6a0a7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:42.037457 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6a474c5-1f20-4290-9f42-b4b976c6a0a7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:42.038283 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6a474c5-1f20-4290-9f42-b4b976c6a0a7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:42.038747 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6a474c5-1f20-4290-9f42-b4b976c6a0a7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:42.039253 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6a474c5-1f20-4290-9f42-b4b976c6a0a7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:42.168784 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a6a474c5-1f20-4290-9f42-b4b976c6a0a7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:42.177906 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a6a474c5-1f20-4290-9f42-b4b976c6a0a7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1733 microversion: 2.1 time: 0.154331 Sep 27 16:41:42.178475 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 358/682] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:42 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:43.201740 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-23b0f8e5-6011-4754-b6e3-531e350f5742 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:43.202430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-23b0f8e5-6011-4754-b6e3-531e350f5742 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:43.209944 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23b0f8e5-6011-4754-b6e3-531e350f5742 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:43.210462 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23b0f8e5-6011-4754-b6e3-531e350f5742 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:43.210926 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23b0f8e5-6011-4754-b6e3-531e350f5742 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:43.211622 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23b0f8e5-6011-4754-b6e3-531e350f5742 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:43.212068 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23b0f8e5-6011-4754-b6e3-531e350f5742 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:43.212486 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23b0f8e5-6011-4754-b6e3-531e350f5742 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:43.351473 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-23b0f8e5-6011-4754-b6e3-531e350f5742 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:43.360253 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-23b0f8e5-6011-4754-b6e3-531e350f5742 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1713 microversion: 2.1 time: 0.163668 Sep 27 16:41:43.362817 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 325/683] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:43 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1713 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:43.482506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1ef19d19-3e90-4bee-b771-bb065fad24a3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:43.483049 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1ef19d19-3e90-4bee-b771-bb065fad24a3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:43.489410 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ef19d19-3e90-4bee-b771-bb065fad24a3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:43.489906 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ef19d19-3e90-4bee-b771-bb065fad24a3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:43.490347 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ef19d19-3e90-4bee-b771-bb065fad24a3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:43.491079 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ef19d19-3e90-4bee-b771-bb065fad24a3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:43.491537 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ef19d19-3e90-4bee-b771-bb065fad24a3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:43.491966 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ef19d19-3e90-4bee-b771-bb065fad24a3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:43.573991 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-1ef19d19-3e90-4bee-b771-bb065fad24a3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] HTTP exception thrown: Cannot 'detach_volume' instance 18c68417-b41c-4ab3-9fac-9e7087bfe731 while it is in vm_state rescued Sep 27 16:41:43.575639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1ef19d19-3e90-4bee-b771-bb065fad24a3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Request method failure captured: Sep 27 16:41:43.575639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: DELETE /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731/os-volume_attachments/7b186cf2-52c0-437f-aa7f-f7e63901c4e7 HTTP/1.1 Sep 27 16:41:43.575639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:41:43.575639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:41:43.575639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:41:43.575639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:41:43.575639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:41:43.575639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:41:43.575639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:41:43.575639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:41:43.575639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMybbp91lepYQw85tUquWCV9UR5RezmQYrVfqE15tUFFE5y2X68s4nmn2P-J26dEvIkXNr6K7LpWu32utpxO1WVZFPVbAUVkBy8ED55Dss_89HF5N9IwPzLh5PE1Lkzf5zU-RvYh05UuJNz1vky_4nFLpZn78rK0k61y3SURPRT-cpXI Sep 27 16:41:43.575639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:41:43.575639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:41:43.575639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:41:43.575639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:41:43.575639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:41:43.575639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:41:43.575639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 9288b4e62bc945479636aec307a98746 Sep 27 16:41:43.575639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-54837262 Sep 27 16:41:43.575639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:41:43.575639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:41:43.577209 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9288b4e62bc945479636aec307a98746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9288b4e62bc945479636aec307a98746"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9288b4e62bc945479636aec307a98746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9288b4e62bc945479636aec307a98746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:41:43.577209 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-ServerRescueNegativeTestJSON-54837262 Sep 27 16:41:43.577209 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 9288b4e62bc945479636aec307a98746 Sep 27 16:41:43.577209 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-54837262 Sep 27 16:41:43.577209 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-ServerRescueNegativeTestJSON-54837262-project Sep 27 16:41:43.577209 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:41:43.577209 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:41:43.577209 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: 2f9e55a3ff7c424dbd7a58f0eb92b8ce Sep 27 16:41:43.577209 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-ServerRescueNegativeTestJSON-54837262-project Sep 27 16:41:43.577209 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:41:43.577209 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Cannot 'detach_volume' instance 18c68417-b41c-4ab3-9fac-9e7087bfe731 while it is in vm_state rescued Sep 27 16:41:43.577979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'server_id': '18c68417-b41c-4ab3-9fac-9e7087bfe731', 'id': '7b186cf2-52c0-437f-aa7f-f7e63901c4e7'} Sep 27 16:41:43.577979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:41:43.577979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:41:43.577979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 27 16:41:43.577979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 27 16:41:43.577979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 16:41:43.577979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 16:41:43.577979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 27 16:41:43.577979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 27 16:41:43.577979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 18c68417-b41c-4ab3-9fac-9e7087bfe731 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 27 16:41:43.577979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:41:43.577979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:41:43.577979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:41:43.577979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:41:43.577979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:41:43.577979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:41:43.577979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:41:43.577979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:41:43.577979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:41:43.577979 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:41:43.579193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 27 16:41:43.579193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 27 16:41:43.579193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 27 16:41:43.579193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 27 16:41:43.579193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 18c68417-b41c-4ab3-9fac-9e7087bfe731 while it is in vm_state rescued Sep 27 16:41:43.579193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:41:43.579193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:41:43.579193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:41:43.579193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:41:43.579193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:41:43.579193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:41:43.579193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:41:43.579193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:41:43.579193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 18c68417-b41c-4ab3-9fac-9e7087bfe731 while it is in vm_state rescued Sep 27 16:41:43.579193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:41:43.579193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1ef19d19-3e90-4bee-b771-bb065fad24a3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Returning 409 to user: Cannot 'detach_volume' instance 18c68417-b41c-4ab3-9fac-9e7087bfe731 while it is in vm_state rescued {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:41:43.580177 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1ef19d19-3e90-4bee-b771-bb065fad24a3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "DELETE /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731/os-volume_attachments/7b186cf2-52c0-437f-aa7f-f7e63901c4e7" status: 409 len: 152 microversion: 2.1 time: 0.098633 Sep 27 16:41:43.580177 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 359/684] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Sep 27 16:41:43 2022] DELETE /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731/os-volume_attachments/7b186cf2-52c0-437f-aa7f-f7e63901c4e7 => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 27 16:41:43.586532 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e246cf4e-998e-4f64-9896-8853da10f40b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:41:43.587099 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e246cf4e-998e-4f64-9896-8853da10f40b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:43.594667 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e246cf4e-998e-4f64-9896-8853da10f40b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:43.595188 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e246cf4e-998e-4f64-9896-8853da10f40b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:43.595625 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e246cf4e-998e-4f64-9896-8853da10f40b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:43.596325 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e246cf4e-998e-4f64-9896-8853da10f40b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:43.596819 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e246cf4e-998e-4f64-9896-8853da10f40b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:43.597227 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e246cf4e-998e-4f64-9896-8853da10f40b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:43.931065 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e246cf4e-998e-4f64-9896-8853da10f40b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "POST /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731/action" status: 202 len: 0 microversion: 2.1 time: 0.348732 Sep 27 16:41:43.931697 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 326/685] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Sep 27 16:41:43 2022] POST /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:41:43.939879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-db9b55a7-da58-4c08-ac04-8b247eff2dab tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:43.940523 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-db9b55a7-da58-4c08-ac04-8b247eff2dab tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:43.947175 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db9b55a7-da58-4c08-ac04-8b247eff2dab tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:43.947666 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db9b55a7-da58-4c08-ac04-8b247eff2dab tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:43.948112 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db9b55a7-da58-4c08-ac04-8b247eff2dab tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:43.948940 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db9b55a7-da58-4c08-ac04-8b247eff2dab tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:43.949401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db9b55a7-da58-4c08-ac04-8b247eff2dab tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:43.949829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db9b55a7-da58-4c08-ac04-8b247eff2dab tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:43.954656 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:44.080110 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-db9b55a7-da58-4c08-ac04-8b247eff2dab tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:44.088477 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-db9b55a7-da58-4c08-ac04-8b247eff2dab tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1721 microversion: 2.1 time: 0.152172 Sep 27 16:41:44.089050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 360/686] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:43 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:45.113334 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0ab9b6ab-1287-4c4b-8c48-71a45fc46cfa tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:45.114207 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0ab9b6ab-1287-4c4b-8c48-71a45fc46cfa tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:45.120046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ab9b6ab-1287-4c4b-8c48-71a45fc46cfa tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:45.122621 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ab9b6ab-1287-4c4b-8c48-71a45fc46cfa tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:45.122621 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ab9b6ab-1287-4c4b-8c48-71a45fc46cfa tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:45.122621 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ab9b6ab-1287-4c4b-8c48-71a45fc46cfa tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:45.122621 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ab9b6ab-1287-4c4b-8c48-71a45fc46cfa tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:45.123011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ab9b6ab-1287-4c4b-8c48-71a45fc46cfa tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:45.495216 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0ab9b6ab-1287-4c4b-8c48-71a45fc46cfa tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:45.503739 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0ab9b6ab-1287-4c4b-8c48-71a45fc46cfa tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1721 microversion: 2.1 time: 0.395312 Sep 27 16:41:45.504397 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 327/687] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:45 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1721 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:41:46.526799 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-632b2f16-d0ea-435b-a14d-46e85d5b89e3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:46.527489 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-632b2f16-d0ea-435b-a14d-46e85d5b89e3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:46.529657 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=42 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:46.539361 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-632b2f16-d0ea-435b-a14d-46e85d5b89e3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:46.539361 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-632b2f16-d0ea-435b-a14d-46e85d5b89e3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:46.539361 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-632b2f16-d0ea-435b-a14d-46e85d5b89e3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:46.539361 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-632b2f16-d0ea-435b-a14d-46e85d5b89e3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:46.539777 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-632b2f16-d0ea-435b-a14d-46e85d5b89e3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:46.539777 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-632b2f16-d0ea-435b-a14d-46e85d5b89e3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:46.667855 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-632b2f16-d0ea-435b-a14d-46e85d5b89e3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:46.676045 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-632b2f16-d0ea-435b-a14d-46e85d5b89e3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1721 microversion: 2.1 time: 0.153050 Sep 27 16:41:46.677151 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 361/688] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:46 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:47.699705 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9ff65327-166b-43a3-8bf5-c00f26f07619 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:47.700310 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9ff65327-166b-43a3-8bf5-c00f26f07619 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:47.706668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9ff65327-166b-43a3-8bf5-c00f26f07619 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:47.707174 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9ff65327-166b-43a3-8bf5-c00f26f07619 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:47.707648 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9ff65327-166b-43a3-8bf5-c00f26f07619 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:47.708324 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9ff65327-166b-43a3-8bf5-c00f26f07619 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:47.708769 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9ff65327-166b-43a3-8bf5-c00f26f07619 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:47.709187 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9ff65327-166b-43a3-8bf5-c00f26f07619 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:47.841210 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9ff65327-166b-43a3-8bf5-c00f26f07619 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:47.849333 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9ff65327-166b-43a3-8bf5-c00f26f07619 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1727 microversion: 2.1 time: 0.153547 Sep 27 16:41:47.849890 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 328/689] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:47 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:47.871930 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ae4ee75d-449b-4cc3-b9e7-bcd7d59c7b23 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:47.872424 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ae4ee75d-449b-4cc3-b9e7-bcd7d59c7b23 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:47.878266 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae4ee75d-449b-4cc3-b9e7-bcd7d59c7b23 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:47.878743 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae4ee75d-449b-4cc3-b9e7-bcd7d59c7b23 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:47.879804 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae4ee75d-449b-4cc3-b9e7-bcd7d59c7b23 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:47.880489 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae4ee75d-449b-4cc3-b9e7-bcd7d59c7b23 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:47.880939 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae4ee75d-449b-4cc3-b9e7-bcd7d59c7b23 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:47.881355 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae4ee75d-449b-4cc3-b9e7-bcd7d59c7b23 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:47.956257 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ae4ee75d-449b-4cc3-b9e7-bcd7d59c7b23 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088261 Sep 27 16:41:47.956861 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 362/690] 10.222.0.64 () {58 vars in 1275 bytes} [Tue Sep 27 16:41:47 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:41:48.926675 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-ff977df6-713d-47b5-9467-63a9463adec5 req-bdc622c1-0cbd-46b4-a54b-de9bc6f314a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c68417-b41c-4ab3-9fac-9e7087bfe731", "tag": "3886c674-6e5a-4ef4-b25f-926b0453292c"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:41:48.941303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-ff977df6-713d-47b5-9467-63a9463adec5 req-bdc622c1-0cbd-46b4-a54b-de9bc6f314a8 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:48.942352 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-ff977df6-713d-47b5-9467-63a9463adec5 req-bdc622c1-0cbd-46b4-a54b-de9bc6f314a8 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:48.942812 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-ff977df6-713d-47b5-9467-63a9463adec5 req-bdc622c1-0cbd-46b4-a54b-de9bc6f314a8 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:48.954667 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-ff977df6-713d-47b5-9467-63a9463adec5 req-bdc622c1-0cbd-46b4-a54b-de9bc6f314a8 service nova] Creating event network-changed:3886c674-6e5a-4ef4-b25f-926b0453292c for instance 18c68417-b41c-4ab3-9fac-9e7087bfe731 on hv-cinder-85506 Sep 27 16:41:48.960657 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-ff977df6-713d-47b5-9467-63a9463adec5 req-bdc622c1-0cbd-46b4-a54b-de9bc6f314a8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037623 Sep 27 16:41:48.961565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 329/691] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:41:49.865302 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-33408b31-edd5-4f85-9240-2ec885747f0e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "189cd509-47f5-49af-94e7-57f5d3fdaf40"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:41:49.867797 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-33408b31-edd5-4f85-9240-2ec885747f0e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:49.874237 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-33408b31-edd5-4f85-9240-2ec885747f0e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:49.874727 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-33408b31-edd5-4f85-9240-2ec885747f0e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:49.875225 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-33408b31-edd5-4f85-9240-2ec885747f0e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:49.875951 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-33408b31-edd5-4f85-9240-2ec885747f0e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:49.876436 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-33408b31-edd5-4f85-9240-2ec885747f0e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:49.877455 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-33408b31-edd5-4f85-9240-2ec885747f0e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:49.962504 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-33408b31-edd5-4f85-9240-2ec885747f0e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] HTTP exception thrown: Invalid volume: volume 189cd509-47f5-49af-94e7-57f5d3fdaf40 is already attached to instances: e036d20a-962b-4196-8b51-1edc199c9700 Sep 27 16:41:49.964158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-33408b31-edd5-4f85-9240-2ec885747f0e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Request method failure captured: Sep 27 16:41:49.964158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: POST /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700/os-volume_attachments HTTP/1.1 Sep 27 16:41:49.964158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:41:49.964158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:41:49.964158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:41:49.964158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 74 Sep 27 16:41:49.964158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:41:49.964158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:41:49.964158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:41:49.964158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:41:49.964158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMyaXt7kpD0PfNVvLYuBuVZ7HRidwt4V7Ad9Ym3_Vbex0YLxAbLBHGS-HGBld9NGzCqyRTvioGgsu3eg4VIjDtZIgTd01qZ6DSQMCZ0BknQO4xdhtqMgcyIwM-7CdV1bNe00wPntnIGZvSkxLDfg4QN7aDekfETC-lFwzlHlACFvCF14 Sep 27 16:41:49.964158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:41:49.964158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:41:49.964158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:41:49.964158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:41:49.964158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:41:49.964158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:41:49.964158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:41:49.964158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:41:49.964158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:41:49.964158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:41:49.965526 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_73fad530905b485cb7141793f6130a9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/73fad530905b485cb7141793f6130a9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:41:49.965526 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:41:49.965526 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:41:49.965526 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:41:49.965526 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:41:49.965526 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:41:49.965526 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:41:49.965526 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: e8d3af2b82b641aea11ebf79677a3af1 Sep 27 16:41:49.965526 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:41:49.965526 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Sep 27 16:41:49.965526 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {"volumeAttachment": {"volumeId": "189cd509-47f5-49af-94e7-57f5d3fdaf40"}} Sep 27 16:41:49.965526 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:41:49.966289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Invalid volume: volume 189cd509-47f5-49af-94e7-57f5d3fdaf40 is already attached to instances: e036d20a-962b-4196-8b51-1edc199c9700 Sep 27 16:41:49.966289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'server_id': 'e036d20a-962b-4196-8b51-1edc199c9700', 'body': {'volumeAttachment': {'volumeId': '189cd509-47f5-49af-94e7-57f5d3fdaf40'}}} Sep 27 16:41:49.966289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:41:49.966289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:41:49.966289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 27 16:41:49.966289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 27 16:41:49.966289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 16:41:49.966289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 16:41:49.966289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 27 16:41:49.966289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 27 16:41:49.966289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 27 16:41:49.966289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 27 16:41:49.966289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 27 16:41:49.966289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 27 16:41:49.966289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 189cd509-47f5-49af-94e7-57f5d3fdaf40 is already attached to instances: e036d20a-962b-4196-8b51-1edc199c9700 Sep 27 16:41:49.966289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:41:49.966289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:41:49.966289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:41:49.966289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:41:49.967498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:41:49.967498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:41:49.967498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:41:49.967498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:41:49.967498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:41:49.967498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:41:49.967498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 16:41:49.967498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 16:41:49.967498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 16:41:49.967498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 16:41:49.967498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 16:41:49.967498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 16:41:49.967498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 27 16:41:49.967498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 27 16:41:49.967498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 189cd509-47f5-49af-94e7-57f5d3fdaf40 is already attached to instances: e036d20a-962b-4196-8b51-1edc199c9700 Sep 27 16:41:49.967498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:41:49.967498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:41:49.967498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:41:49.967498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:41:49.967498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:41:49.968777 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:41:49.968777 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:41:49.968777 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:41:49.968777 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 189cd509-47f5-49af-94e7-57f5d3fdaf40 is already attached to instances: e036d20a-962b-4196-8b51-1edc199c9700 Sep 27 16:41:49.968777 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:41:49.968777 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-33408b31-edd5-4f85-9240-2ec885747f0e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Returning 400 to user: Invalid volume: volume 189cd509-47f5-49af-94e7-57f5d3fdaf40 is already attached to instances: e036d20a-962b-4196-8b51-1edc199c9700 {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:41:49.968777 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-33408b31-edd5-4f85-9240-2ec885747f0e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "POST /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105138 Sep 27 16:41:49.968777 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 363/692] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Sep 27 16:41:49 2022] POST /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 16:41:50.036460 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e6154ed1-4dc6-4e25-a8f4-30f95fce5ba0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:50.037037 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e6154ed1-4dc6-4e25-a8f4-30f95fce5ba0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:50.043064 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6154ed1-4dc6-4e25-a8f4-30f95fce5ba0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:50.043544 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6154ed1-4dc6-4e25-a8f4-30f95fce5ba0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:50.043978 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6154ed1-4dc6-4e25-a8f4-30f95fce5ba0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:50.044662 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6154ed1-4dc6-4e25-a8f4-30f95fce5ba0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:50.045108 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6154ed1-4dc6-4e25-a8f4-30f95fce5ba0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:50.045524 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6154ed1-4dc6-4e25-a8f4-30f95fce5ba0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:50.169914 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-e6154ed1-4dc6-4e25-a8f4-30f95fce5ba0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lazy-loading 'services' on Instance uuid e036d20a-962b-4196-8b51-1edc199c9700 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:41:50.383807 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e6154ed1-4dc6-4e25-a8f4-30f95fce5ba0 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700/os-volume_attachments/189cd509-47f5-49af-94e7-57f5d3fdaf40" status: 202 len: 0 microversion: 2.1 time: 0.352535 Sep 27 16:41:50.384427 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 330/693] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Sep 27 16:41:50 2022] DELETE /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700/os-volume_attachments/189cd509-47f5-49af-94e7-57f5d3fdaf40 => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:41:50.393968 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-249aa173-6875-4f65-a26f-edcee073e234 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:50.398052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-249aa173-6875-4f65-a26f-edcee073e234 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:50.404185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-249aa173-6875-4f65-a26f-edcee073e234 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:50.404674 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-249aa173-6875-4f65-a26f-edcee073e234 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:50.405194 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-249aa173-6875-4f65-a26f-edcee073e234 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:50.405892 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-249aa173-6875-4f65-a26f-edcee073e234 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:50.406610 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-249aa173-6875-4f65-a26f-edcee073e234 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:50.407072 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-249aa173-6875-4f65-a26f-edcee073e234 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:50.439731 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-249aa173-6875-4f65-a26f-edcee073e234 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050288 Sep 27 16:41:50.440288 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 364/694] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Sep 27 16:41:50 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:41:50.976071 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-25f8edf5-86e9-405d-89a2-deabea1be3a7 req-5b34931d-67b5-4cbb-80cf-eca1b12394ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c68417-b41c-4ab3-9fac-9e7087bfe731", "tag": "3886c674-6e5a-4ef4-b25f-926b0453292c"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:41:50.985719 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-25f8edf5-86e9-405d-89a2-deabea1be3a7 req-5b34931d-67b5-4cbb-80cf-eca1b12394ca service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:50.986198 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-25f8edf5-86e9-405d-89a2-deabea1be3a7 req-5b34931d-67b5-4cbb-80cf-eca1b12394ca service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:50.986656 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-25f8edf5-86e9-405d-89a2-deabea1be3a7 req-5b34931d-67b5-4cbb-80cf-eca1b12394ca service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:50.999350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-25f8edf5-86e9-405d-89a2-deabea1be3a7 req-5b34931d-67b5-4cbb-80cf-eca1b12394ca service nova] Creating event network-changed:3886c674-6e5a-4ef4-b25f-926b0453292c for instance 18c68417-b41c-4ab3-9fac-9e7087bfe731 on hv-cinder-85506 Sep 27 16:41:51.004284 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-25f8edf5-86e9-405d-89a2-deabea1be3a7 req-5b34931d-67b5-4cbb-80cf-eca1b12394ca service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033300 Sep 27 16:41:51.005064 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 331/695] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:41:51.453274 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8f3a7e12-ca4b-40cf-9035-aa9d435be77f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:51.455450 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8f3a7e12-ca4b-40cf-9035-aa9d435be77f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:51.462452 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f3a7e12-ca4b-40cf-9035-aa9d435be77f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:51.463003 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f3a7e12-ca4b-40cf-9035-aa9d435be77f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:51.463434 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f3a7e12-ca4b-40cf-9035-aa9d435be77f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:51.464129 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f3a7e12-ca4b-40cf-9035-aa9d435be77f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:51.464580 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f3a7e12-ca4b-40cf-9035-aa9d435be77f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:51.465031 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f3a7e12-ca4b-40cf-9035-aa9d435be77f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:51.497578 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8f3a7e12-ca4b-40cf-9035-aa9d435be77f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048075 Sep 27 16:41:51.503690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 365/696] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Sep 27 16:41:51 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 16:41:51.565722 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cb451ffe-20f6-4e81-954c-741b0effaac4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:51.569058 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cb451ffe-20f6-4e81-954c-741b0effaac4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:51.575345 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb451ffe-20f6-4e81-954c-741b0effaac4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:51.575844 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb451ffe-20f6-4e81-954c-741b0effaac4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:51.576286 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb451ffe-20f6-4e81-954c-741b0effaac4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:51.576978 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb451ffe-20f6-4e81-954c-741b0effaac4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:51.577424 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb451ffe-20f6-4e81-954c-741b0effaac4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:51.577835 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb451ffe-20f6-4e81-954c-741b0effaac4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:51.605578 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cb451ffe-20f6-4e81-954c-741b0effaac4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 16:41:51.852962 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-cb451ffe-20f6-4e81-954c-741b0effaac4 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 204 len: 0 microversion: 2.1 time: 0.291729 Sep 27 16:41:51.853553 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 332/697] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:41:51 2022] DELETE /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 16:41:51.861843 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1bc4ee23-4ade-48be-8056-9f53c9015941 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:51.866211 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1bc4ee23-4ade-48be-8056-9f53c9015941 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:51.869514 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bc4ee23-4ade-48be-8056-9f53c9015941 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:51.870033 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bc4ee23-4ade-48be-8056-9f53c9015941 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:51.870513 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bc4ee23-4ade-48be-8056-9f53c9015941 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:51.871270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bc4ee23-4ade-48be-8056-9f53c9015941 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:51.871720 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bc4ee23-4ade-48be-8056-9f53c9015941 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:51.872157 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bc4ee23-4ade-48be-8056-9f53c9015941 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:52.007733 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1bc4ee23-4ade-48be-8056-9f53c9015941 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:52.015832 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1bc4ee23-4ade-48be-8056-9f53c9015941 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 200 len: 1681 microversion: 2.1 time: 0.157867 Sep 27 16:41:52.016386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 366/698] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:51 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:53.040603 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4ee2b834-6ad3-488d-877d-242610348ad1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:53.041515 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4ee2b834-6ad3-488d-877d-242610348ad1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:53.047959 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ee2b834-6ad3-488d-877d-242610348ad1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:53.048664 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ee2b834-6ad3-488d-877d-242610348ad1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:53.049098 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ee2b834-6ad3-488d-877d-242610348ad1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:53.049792 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ee2b834-6ad3-488d-877d-242610348ad1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:53.050246 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ee2b834-6ad3-488d-877d-242610348ad1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:53.050670 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ee2b834-6ad3-488d-877d-242610348ad1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:53.186034 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4ee2b834-6ad3-488d-877d-242610348ad1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:53.194449 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4ee2b834-6ad3-488d-877d-242610348ad1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 200 len: 1681 microversion: 2.1 time: 0.158766 Sep 27 16:41:53.195046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 333/699] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:53 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:54.219709 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-abdd57d1-47b0-4664-8388-27e570b8a891 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:54.220431 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-abdd57d1-47b0-4664-8388-27e570b8a891 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:54.234108 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abdd57d1-47b0-4664-8388-27e570b8a891 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:54.234835 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abdd57d1-47b0-4664-8388-27e570b8a891 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:54.235286 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abdd57d1-47b0-4664-8388-27e570b8a891 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:54.236005 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abdd57d1-47b0-4664-8388-27e570b8a891 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:54.236630 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abdd57d1-47b0-4664-8388-27e570b8a891 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:54.237062 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abdd57d1-47b0-4664-8388-27e570b8a891 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:54.305028 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-abdd57d1-47b0-4664-8388-27e570b8a891 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:54.311574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-abdd57d1-47b0-4664-8388-27e570b8a891 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 200 len: 1613 microversion: 2.1 time: 0.097301 Sep 27 16:41:54.312156 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 367/700] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:54 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 1613 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:54.503881 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-2e824658-55d8-46c8-b155-737258854dea req-a15f0940-aa02-4acd-a667-ee29b24c3203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e036d20a-962b-4196-8b51-1edc199c9700", "name": "network-vif-deleted", "tag": "9a15757f-ac3b-4ddc-80eb-dac8224d7ea4"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:41:54.510673 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:41:54.516417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-2e824658-55d8-46c8-b155-737258854dea req-a15f0940-aa02-4acd-a667-ee29b24c3203 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:54.516898 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-2e824658-55d8-46c8-b155-737258854dea req-a15f0940-aa02-4acd-a667-ee29b24c3203 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:54.517330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-2e824658-55d8-46c8-b155-737258854dea req-a15f0940-aa02-4acd-a667-ee29b24c3203 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:54.529369 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-2e824658-55d8-46c8-b155-737258854dea req-a15f0940-aa02-4acd-a667-ee29b24c3203 service nova] Creating event network-vif-deleted:9a15757f-ac3b-4ddc-80eb-dac8224d7ea4 for instance e036d20a-962b-4196-8b51-1edc199c9700 on hv-cinder-85506 Sep 27 16:41:54.534461 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-2e824658-55d8-46c8-b155-737258854dea req-a15f0940-aa02-4acd-a667-ee29b24c3203 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034234 Sep 27 16:41:54.535128 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 334/701] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:41:55.341588 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-34a78016-e653-4eb3-868e-16631eb49d3c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:55.342289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-34a78016-e653-4eb3-868e-16631eb49d3c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:55.348572 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-34a78016-e653-4eb3-868e-16631eb49d3c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:55.349953 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-34a78016-e653-4eb3-868e-16631eb49d3c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:55.350723 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-34a78016-e653-4eb3-868e-16631eb49d3c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:55.351443 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-34a78016-e653-4eb3-868e-16631eb49d3c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:55.351547 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-34a78016-e653-4eb3-868e-16631eb49d3c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:55.351982 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-34a78016-e653-4eb3-868e-16631eb49d3c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:55.384312 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-34a78016-e653-4eb3-868e-16631eb49d3c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:55.384793 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-34a78016-e653-4eb3-868e-16631eb49d3c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:55.385223 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-34a78016-e653-4eb3-868e-16631eb49d3c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:55.385664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-34a78016-e653-4eb3-868e-16631eb49d3c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lazy-loading 'fault' on Instance uuid e036d20a-962b-4196-8b51-1edc199c9700 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:41:55.428121 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-34a78016-e653-4eb3-868e-16631eb49d3c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:41:55.435967 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-34a78016-e653-4eb3-868e-16631eb49d3c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 200 len: 1331 microversion: 2.1 time: 0.098573 Sep 27 16:41:55.437143 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 368/702] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:55 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:41:56.461673 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d7c6dcaa-6354-4bfb-bbf6-69118a806da6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:56.462371 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d7c6dcaa-6354-4bfb-bbf6-69118a806da6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:41:56.469009 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7c6dcaa-6354-4bfb-bbf6-69118a806da6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:56.469484 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7c6dcaa-6354-4bfb-bbf6-69118a806da6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:56.469911 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7c6dcaa-6354-4bfb-bbf6-69118a806da6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:56.470592 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7c6dcaa-6354-4bfb-bbf6-69118a806da6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:41:56.471069 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7c6dcaa-6354-4bfb-bbf6-69118a806da6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:41:56.474185 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7c6dcaa-6354-4bfb-bbf6-69118a806da6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:41:56.484654 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-d7c6dcaa-6354-4bfb-bbf6-69118a806da6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] HTTP exception thrown: Instance e036d20a-962b-4196-8b51-1edc199c9700 could not be found. Sep 27 16:41:56.486282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d7c6dcaa-6354-4bfb-bbf6-69118a806da6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Request method failure captured: Sep 27 16:41:56.486282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 HTTP/1.1 Sep 27 16:41:56.486282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:41:56.486282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:41:56.486282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:41:56.486282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 27 16:41:56.486282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:41:56.486282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:41:56.486282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:41:56.486282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:41:56.486282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMyaXt7kpD0PfNVvLYuBuVZ7HRidwt4V7Ad9Ym3_Vbex0YLxAbLBHGS-HGBld9NGzCqyRTvioGgsu3eg4VIjDtZIgTd01qZ6DSQMCZ0BknQO4xdhtqMgcyIwM-7CdV1bNe00wPntnIGZvSkxLDfg4QN7aDekfETC-lFwzlHlACFvCF14 Sep 27 16:41:56.486282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:41:56.486282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:41:56.486282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:41:56.486282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:41:56.486282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:41:56.486282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:41:56.486282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:41:56.486282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:41:56.486282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:41:56.486282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:41:56.487803 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_73fad530905b485cb7141793f6130a9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/73fad530905b485cb7141793f6130a9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:41:56.487803 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:41:56.487803 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:41:56.487803 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:41:56.487803 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:41:56.487803 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:41:56.487803 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:41:56.487803 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: e8d3af2b82b641aea11ebf79677a3af1 Sep 27 16:41:56.487803 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:41:56.487803 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: > Sep 27 16:41:56.487803 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Instance e036d20a-962b-4196-8b51-1edc199c9700 could not be found. Sep 27 16:41:56.487803 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'id': 'e036d20a-962b-4196-8b51-1edc199c9700'} Sep 27 16:41:56.488747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:41:56.488747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:41:56.488747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:41:56.488747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:41:56.488747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:41:56.488747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:41:56.488747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:41:56.488747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:41:56.488747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:41:56.488747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:41:56.488747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e036d20a-962b-4196-8b51-1edc199c9700 could not be found. Sep 27 16:41:56.488747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:41:56.488747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:41:56.488747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:41:56.488747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:41:56.488747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:41:56.488747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:41:56.488747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:41:56.488747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:41:56.488747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:41:56.490506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:41:56.490506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:41:56.490506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:41:56.490506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:41:56.490506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:41:56.490506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:41:56.490506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:41:56.490506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e036d20a-962b-4196-8b51-1edc199c9700 could not be found. Sep 27 16:41:56.490506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:41:56.490506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:41:56.490506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:41:56.490506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:41:56.490506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:41:56.490506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:41:56.490506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:41:56.490506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:41:56.490506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e036d20a-962b-4196-8b51-1edc199c9700 could not be found. Sep 27 16:41:56.490506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:41:56.491992 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d7c6dcaa-6354-4bfb-bbf6-69118a806da6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Returning 404 to user: Instance e036d20a-962b-4196-8b51-1edc199c9700 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:41:56.491992 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d7c6dcaa-6354-4bfb-bbf6-69118a806da6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 404 len: 111 microversion: 2.1 time: 0.031519 Sep 27 16:41:56.491992 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 335/703] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:41:56 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:41:56.496481 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-657d4d06-b847-440d-ad16-3fe897cffa1d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '.version_select at 0x7fa405c94280>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:41:56.562398 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-657d4d06-b847-440d-ad16-3fe897cffa1d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-956496552" status: 202 len: 0 microversion: 2.1 time: 0.069618 Sep 27 16:41:56.563028 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 369/704] 10.222.0.64 () {58 vars in 1218 bytes} [Tue Sep 27 16:41:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-956496552 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:41:57.301607 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a09707e3-b0d6-42ef-81b9-4430e85a1b7a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Action: 'create', calling method: .version_select at 0x7fa40572eb80>, body: {"keypair": {"name": "tempest-keypair-2035466754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzAZl4ulIl649yyo+Wf5w3IxusBmA+VfsYslsFzn0Bgt4b3ZfuYvu2bMJ0AV8SDhsHTTvJXITyKCLxaA4WhKmB3kUWhvomfQY8Op/NZ5E+5407MUEtzuiJhNOHefeN6ow=="}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:41:57.317415 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-a09707e3-b0d6-42ef-81b9-4430e85a1b7a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Getting quotas for project 73fad530905b485cb7141793f6130a9e. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:41:57.321352 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-a09707e3-b0d6-42ef-81b9-4430e85a1b7a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Getting quotas for user e8d3af2b82b641aea11ebf79677a3af1 and project 73fad530905b485cb7141793f6130a9e. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:41:57.408559 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a09707e3-b0d6-42ef-81b9-4430e85a1b7a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110805 Sep 27 16:41:57.409152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 336/705] 10.222.0.64 () {60 vars in 1159 bytes} [Tue Sep 27 16:41:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:41:59.828784 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b07dff7e-e4df-425b-8c9c-bdc91e5750e3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-223791081", "imageRef": "6908a343-46fa-4801-bfb5-7ad92ac26956", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16983143-f1f9-476b-8846-75cee163a487"}], "security_groups": [{"name": "tempest-securitygroup--135623472"}], "key_name": "tempest-keypair-2035466754", "user_data": "}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:41:59.933492 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-b07dff7e-e4df-425b-8c9c-bdc91e5750e3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] validate_networks() for [('16983143-f1f9-476b-8846-75cee163a487', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 16:42:00.386970 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-b07dff7e-e4df-425b-8c9c-bdc91e5750e3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 16:42:00.387402 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-b07dff7e-e4df-425b-8c9c-bdc91e5750e3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 16:42:00.387881 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-b07dff7e-e4df-425b-8c9c-bdc91e5750e3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 16:42:00.388291 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-b07dff7e-e4df-425b-8c9c-bdc91e5750e3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 16:42:00.388709 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-b07dff7e-e4df-425b-8c9c-bdc91e5750e3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 16:42:00.397696 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b07dff7e-e4df-425b-8c9c-bdc91e5750e3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:00.398184 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b07dff7e-e4df-425b-8c9c-bdc91e5750e3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:00.398627 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b07dff7e-e4df-425b-8c9c-bdc91e5750e3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:00.399403 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b07dff7e-e4df-425b-8c9c-bdc91e5750e3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:00.399862 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b07dff7e-e4df-425b-8c9c-bdc91e5750e3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:00.400294 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b07dff7e-e4df-425b-8c9c-bdc91e5750e3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:00.417892 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-b07dff7e-e4df-425b-8c9c-bdc91e5750e3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Getting quotas for project 73fad530905b485cb7141793f6130a9e. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:42:00.421957 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-b07dff7e-e4df-425b-8c9c-bdc91e5750e3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Getting quotas for user e8d3af2b82b641aea11ebf79677a3af1 and project 73fad530905b485cb7141793f6130a9e. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:42:00.433454 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b07dff7e-e4df-425b-8c9c-bdc91e5750e3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 16:42:00.435759 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b07dff7e-e4df-425b-8c9c-bdc91e5750e3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6908a343-46fa-4801-bfb5-7ad92ac26956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 16:42:00.560585 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b07dff7e-e4df-425b-8c9c-bdc91e5750e3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.736162 Sep 27 16:42:00.561234 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 370/706] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Sep 27 16:41:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 16:42:00.572783 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-77875a51-3033-46c7-a7b4-c46b57d8bc78 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:00.573394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-77875a51-3033-46c7-a7b4-c46b57d8bc78 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:00.631679 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-77875a51-3033-46c7-a7b4-c46b57d8bc78 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:00.638606 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-77875a51-3033-46c7-a7b4-c46b57d8bc78 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4" status: 200 len: 1241 microversion: 2.1 time: 0.069616 Sep 27 16:42:00.651128 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 337/707] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:00 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:00.808600 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bafcf431-5b01-428e-9c50-bcb37edc1cff tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-432054214"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:42:00.809182 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bafcf431-5b01-428e-9c50-bcb37edc1cff tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:00.815850 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bafcf431-5b01-428e-9c50-bcb37edc1cff tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:00.816269 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bafcf431-5b01-428e-9c50-bcb37edc1cff tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:00.816715 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bafcf431-5b01-428e-9c50-bcb37edc1cff tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:00.817554 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bafcf431-5b01-428e-9c50-bcb37edc1cff tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:00.818074 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bafcf431-5b01-428e-9c50-bcb37edc1cff tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:00.818802 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bafcf431-5b01-428e-9c50-bcb37edc1cff tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:00.949012 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.network.security_group_api [None req-bafcf431-5b01-428e-9c50-bcb37edc1cff tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Removing security group 02540f7c-f22e-42a2-9262-958f6ddd2582 from port 95614818-7cd1-4590-9696-e7a8c3f6a751 Sep 27 16:42:01.364778 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bafcf431-5b01-428e-9c50-bcb37edc1cff tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "POST /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7/action" status: 202 len: 0 microversion: 2.1 time: 0.560093 Sep 27 16:42:01.365394 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 371/708] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Sep 27 16:42:00 2022] POST /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:42:01.541218 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-c2a7db98-3675-48bc-874c-d2094fdd967e req-2fea5a3e-5a4e-4567-954e-76d5995ca092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54bed735-4766-4b93-9db9-4c3731eec6c7", "tag": "95614818-7cd1-4590-9696-e7a8c3f6a751"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:42:01.551003 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-c2a7db98-3675-48bc-874c-d2094fdd967e req-2fea5a3e-5a4e-4567-954e-76d5995ca092 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:01.551623 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-c2a7db98-3675-48bc-874c-d2094fdd967e req-2fea5a3e-5a4e-4567-954e-76d5995ca092 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:01.552547 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-c2a7db98-3675-48bc-874c-d2094fdd967e req-2fea5a3e-5a4e-4567-954e-76d5995ca092 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:01.564454 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-c2a7db98-3675-48bc-874c-d2094fdd967e req-2fea5a3e-5a4e-4567-954e-76d5995ca092 service nova] Creating event network-changed:95614818-7cd1-4590-9696-e7a8c3f6a751 for instance 54bed735-4766-4b93-9db9-4c3731eec6c7 on hv-cinder-85506 Sep 27 16:42:01.570367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-c2a7db98-3675-48bc-874c-d2094fdd967e req-2fea5a3e-5a4e-4567-954e-76d5995ca092 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200227 Sep 27 16:42:01.571513 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 338/709] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:42:01.665228 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2f0a1cc1-863a-4053-af07-c7bb204fd27a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:01.665995 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2f0a1cc1-863a-4053-af07-c7bb204fd27a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:01.680184 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f0a1cc1-863a-4053-af07-c7bb204fd27a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:01.680935 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f0a1cc1-863a-4053-af07-c7bb204fd27a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:01.681572 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f0a1cc1-863a-4053-af07-c7bb204fd27a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:01.682478 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f0a1cc1-863a-4053-af07-c7bb204fd27a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:01.683269 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f0a1cc1-863a-4053-af07-c7bb204fd27a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:01.683864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f0a1cc1-863a-4053-af07-c7bb204fd27a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:01.792462 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2f0a1cc1-863a-4053-af07-c7bb204fd27a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:01.800879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2f0a1cc1-863a-4053-af07-c7bb204fd27a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4" status: 200 len: 1245 microversion: 2.1 time: 0.141264 Sep 27 16:42:01.802435 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 372/710] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:01 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 => generated 1245 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:02.826070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9cee3de8-5092-41a1-99ba-cdee64b553df tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:02.827520 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9cee3de8-5092-41a1-99ba-cdee64b553df tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:02.834308 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9cee3de8-5092-41a1-99ba-cdee64b553df tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:02.835106 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9cee3de8-5092-41a1-99ba-cdee64b553df tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:02.835555 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9cee3de8-5092-41a1-99ba-cdee64b553df tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:02.836267 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9cee3de8-5092-41a1-99ba-cdee64b553df tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:02.836725 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9cee3de8-5092-41a1-99ba-cdee64b553df tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:02.837151 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9cee3de8-5092-41a1-99ba-cdee64b553df tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:02.912494 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9cee3de8-5092-41a1-99ba-cdee64b553df tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:02.923847 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9cee3de8-5092-41a1-99ba-cdee64b553df tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4" status: 200 len: 1301 microversion: 2.1 time: 0.102747 Sep 27 16:42:02.924977 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 339/711] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:02 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 => generated 1301 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:02.966394 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ac0f511c-92a7-42cc-a9f9-073ecdb3987d tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:02.967603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ac0f511c-92a7-42cc-a9f9-073ecdb3987d tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:02.975930 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac0f511c-92a7-42cc-a9f9-073ecdb3987d tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:02.976713 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac0f511c-92a7-42cc-a9f9-073ecdb3987d tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:02.977349 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac0f511c-92a7-42cc-a9f9-073ecdb3987d tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:02.978147 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac0f511c-92a7-42cc-a9f9-073ecdb3987d tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:02.978899 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac0f511c-92a7-42cc-a9f9-073ecdb3987d tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:02.979420 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac0f511c-92a7-42cc-a9f9-073ecdb3987d tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:03.074195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-ac0f511c-92a7-42cc-a9f9-073ecdb3987d tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lazy-loading 'services' on Instance uuid 54bed735-4766-4b93-9db9-4c3731eec6c7 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:42:03.270752 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ac0f511c-92a7-42cc-a9f9-073ecdb3987d tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "DELETE /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7/os-volume_attachments/0ea51b63-250a-46c9-89d9-c5fd775311ca" status: 202 len: 0 microversion: 2.1 time: 0.307869 Sep 27 16:42:03.271682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 373/712] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Sep 27 16:42:02 2022] DELETE /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7/os-volume_attachments/0ea51b63-250a-46c9-89d9-c5fd775311ca => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:42:03.281167 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-179e5cd3-8849-453b-a792-b56b67a30747 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:03.285200 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-179e5cd3-8849-453b-a792-b56b67a30747 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:03.295880 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-179e5cd3-8849-453b-a792-b56b67a30747 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:03.296683 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-179e5cd3-8849-453b-a792-b56b67a30747 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:03.297316 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-179e5cd3-8849-453b-a792-b56b67a30747 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:03.299239 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-179e5cd3-8849-453b-a792-b56b67a30747 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:03.299850 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-179e5cd3-8849-453b-a792-b56b67a30747 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:03.300428 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-179e5cd3-8849-453b-a792-b56b67a30747 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:03.337441 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-179e5cd3-8849-453b-a792-b56b67a30747 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061202 Sep 27 16:42:03.338583 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 340/713] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Sep 27 16:42:03 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:42:03.587197 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-b2ef3336-3220-42b7-8a8c-1303bcaa2903 req-132b3dac-7509-4274-a4fb-8de3e4bb00c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54bed735-4766-4b93-9db9-4c3731eec6c7", "tag": "95614818-7cd1-4590-9696-e7a8c3f6a751"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:42:03.597195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b2ef3336-3220-42b7-8a8c-1303bcaa2903 req-132b3dac-7509-4274-a4fb-8de3e4bb00c1 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:03.597819 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b2ef3336-3220-42b7-8a8c-1303bcaa2903 req-132b3dac-7509-4274-a4fb-8de3e4bb00c1 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:03.598286 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b2ef3336-3220-42b7-8a8c-1303bcaa2903 req-132b3dac-7509-4274-a4fb-8de3e4bb00c1 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:03.610166 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-b2ef3336-3220-42b7-8a8c-1303bcaa2903 req-132b3dac-7509-4274-a4fb-8de3e4bb00c1 service nova] Creating event network-changed:95614818-7cd1-4590-9696-e7a8c3f6a751 for instance 54bed735-4766-4b93-9db9-4c3731eec6c7 on hv-cinder-85506 Sep 27 16:42:03.616631 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-b2ef3336-3220-42b7-8a8c-1303bcaa2903 req-132b3dac-7509-4274-a4fb-8de3e4bb00c1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033465 Sep 27 16:42:03.620541 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 374/714] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:42:03.949495 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-36cb515a-d935-42c4-8ab8-dfb34bbabffc tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:03.950111 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-36cb515a-d935-42c4-8ab8-dfb34bbabffc tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:03.962131 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-36cb515a-d935-42c4-8ab8-dfb34bbabffc tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:03.964227 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-36cb515a-d935-42c4-8ab8-dfb34bbabffc tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:03.964227 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-36cb515a-d935-42c4-8ab8-dfb34bbabffc tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:03.964227 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-36cb515a-d935-42c4-8ab8-dfb34bbabffc tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:03.964690 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-36cb515a-d935-42c4-8ab8-dfb34bbabffc tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:03.965204 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-36cb515a-d935-42c4-8ab8-dfb34bbabffc tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:04.130760 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-36cb515a-d935-42c4-8ab8-dfb34bbabffc tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:04.138705 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-36cb515a-d935-42c4-8ab8-dfb34bbabffc tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4" status: 200 len: 1366 microversion: 2.1 time: 0.193847 Sep 27 16:42:04.139315 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 341/715] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:03 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:04.352228 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-52acef3f-b172-4a02-8b4e-039c79978720 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:04.354551 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-52acef3f-b172-4a02-8b4e-039c79978720 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:04.361195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-52acef3f-b172-4a02-8b4e-039c79978720 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:04.361688 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-52acef3f-b172-4a02-8b4e-039c79978720 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:04.362132 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-52acef3f-b172-4a02-8b4e-039c79978720 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:04.362858 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-52acef3f-b172-4a02-8b4e-039c79978720 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:04.363339 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-52acef3f-b172-4a02-8b4e-039c79978720 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:04.363791 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-52acef3f-b172-4a02-8b4e-039c79978720 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:04.393929 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-52acef3f-b172-4a02-8b4e-039c79978720 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046781 Sep 27 16:42:04.394474 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 375/716] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Sep 27 16:42:04 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:42:05.163117 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bb78ab1c-55f1-4632-b1c7-affb309c2555 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:05.163724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bb78ab1c-55f1-4632-b1c7-affb309c2555 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:05.170104 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb78ab1c-55f1-4632-b1c7-affb309c2555 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:05.170589 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb78ab1c-55f1-4632-b1c7-affb309c2555 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:05.171051 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb78ab1c-55f1-4632-b1c7-affb309c2555 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:05.171752 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb78ab1c-55f1-4632-b1c7-affb309c2555 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:05.172444 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb78ab1c-55f1-4632-b1c7-affb309c2555 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:05.172615 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb78ab1c-55f1-4632-b1c7-affb309c2555 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:05.264507 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-7ecfd908-905a-452a-93fb-897e00f30dec req-04158265-d072-42a4-a096-1af642d93fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "742a4313-504c-4882-8811-aafcac933bf4", "tag": "cf0033be-5776-4a8f-b33f-08ea7fc21985"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:42:05.275169 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-7ecfd908-905a-452a-93fb-897e00f30dec req-04158265-d072-42a4-a096-1af642d93fd5 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:05.275656 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-7ecfd908-905a-452a-93fb-897e00f30dec req-04158265-d072-42a4-a096-1af642d93fd5 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:05.276089 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-7ecfd908-905a-452a-93fb-897e00f30dec req-04158265-d072-42a4-a096-1af642d93fd5 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:05.289435 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-7ecfd908-905a-452a-93fb-897e00f30dec req-04158265-d072-42a4-a096-1af642d93fd5 service nova] Creating event network-changed:cf0033be-5776-4a8f-b33f-08ea7fc21985 for instance 742a4313-504c-4882-8811-aafcac933bf4 on hv-cinder-85506 Sep 27 16:42:05.294580 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-7ecfd908-905a-452a-93fb-897e00f30dec req-04158265-d072-42a4-a096-1af642d93fd5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109097 Sep 27 16:42:05.295416 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 376/717] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:42:05.320779 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bb78ab1c-55f1-4632-b1c7-affb309c2555 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:05.330053 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bb78ab1c-55f1-4632-b1c7-affb309c2555 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4" status: 200 len: 1366 microversion: 2.1 time: 0.171074 Sep 27 16:42:05.330637 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 342/718] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:05 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:05.408139 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-99ed5f14-b3c3-432e-bdea-80fc1f26bb31 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:05.410364 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-99ed5f14-b3c3-432e-bdea-80fc1f26bb31 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:05.416552 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-99ed5f14-b3c3-432e-bdea-80fc1f26bb31 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:05.417035 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-99ed5f14-b3c3-432e-bdea-80fc1f26bb31 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:05.417472 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-99ed5f14-b3c3-432e-bdea-80fc1f26bb31 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:05.418160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-99ed5f14-b3c3-432e-bdea-80fc1f26bb31 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:05.418612 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-99ed5f14-b3c3-432e-bdea-80fc1f26bb31 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:05.419060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-99ed5f14-b3c3-432e-bdea-80fc1f26bb31 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:05.447665 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-99ed5f14-b3c3-432e-bdea-80fc1f26bb31 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044107 Sep 27 16:42:05.448235 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 377/719] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Sep 27 16:42:05 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 16:42:05.459522 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c607e1ff-b0bf-47e9-ac3b-109c64d8b4db tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:05.460008 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c607e1ff-b0bf-47e9-ac3b-109c64d8b4db tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:05.465934 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c607e1ff-b0bf-47e9-ac3b-109c64d8b4db tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:05.466412 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c607e1ff-b0bf-47e9-ac3b-109c64d8b4db tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:05.466859 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c607e1ff-b0bf-47e9-ac3b-109c64d8b4db tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:05.467544 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c607e1ff-b0bf-47e9-ac3b-109c64d8b4db tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:05.467984 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c607e1ff-b0bf-47e9-ac3b-109c64d8b4db tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:05.468397 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c607e1ff-b0bf-47e9-ac3b-109c64d8b4db tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:05.485937 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:05.545437 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-c607e1ff-b0bf-47e9-ac3b-109c64d8b4db tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] HTTP exception thrown: Instance 54bed735-4766-4b93-9db9-4c3731eec6c7 is not attached to volume 0ea51b63-250a-46c9-89d9-c5fd775311ca Sep 27 16:42:05.558417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c607e1ff-b0bf-47e9-ac3b-109c64d8b4db tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Request method failure captured: Sep 27 16:42:05.558417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7/os-volume_attachments/0ea51b63-250a-46c9-89d9-c5fd775311ca HTTP/1.1 Sep 27 16:42:05.558417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:42:05.558417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:42:05.558417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:42:05.558417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 27 16:42:05.558417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:42:05.558417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:42:05.558417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:42:05.558417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:42:05.558417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMyb6Xqea6g748Vc21dWHHjRVZm-FB6s3tkeI4qOAFf4xjwqbrdwDzg60KU8tx_nLSXa942xNmUwH2FI1dtCFQgt6qPyMYzOVZuwSfxwPtmzVfkw_nadP-KXMeqA_NRcu1fnEIkG5CXrzrXXDrE3zB3Op3OMnNIbW-V6jCtS4FzLg7NI Sep 27 16:42:05.558417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:42:05.558417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:42:05.558417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:42:05.558417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:42:05.558417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:42:05.558417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:42:05.558417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: d5fb5144fbf64abe8ec6b37c7f0444b3 Sep 27 16:42:05.558417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-TestMinimumBasicScenario-227384981 Sep 27 16:42:05.558417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:42:05.558417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:42:05.561345 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d5fb5144fbf64abe8ec6b37c7f0444b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d5fb5144fbf64abe8ec6b37c7f0444b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d5fb5144fbf64abe8ec6b37c7f0444b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d5fb5144fbf64abe8ec6b37c7f0444b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:42:05.561345 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-TestMinimumBasicScenario-227384981 Sep 27 16:42:05.561345 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: d5fb5144fbf64abe8ec6b37c7f0444b3 Sep 27 16:42:05.561345 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-TestMinimumBasicScenario-227384981 Sep 27 16:42:05.561345 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-TestMinimumBasicScenario-227384981-project Sep 27 16:42:05.561345 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:42:05.561345 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:42:05.561345 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: 978e8037ce1d4742abe66ea12d660479 Sep 27 16:42:05.561345 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-TestMinimumBasicScenario-227384981-project Sep 27 16:42:05.561345 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: > Sep 27 16:42:05.561345 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Instance 54bed735-4766-4b93-9db9-4c3731eec6c7 is not attached to volume 0ea51b63-250a-46c9-89d9-c5fd775311ca Sep 27 16:42:05.562046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'server_id': '54bed735-4766-4b93-9db9-4c3731eec6c7', 'id': '0ea51b63-250a-46c9-89d9-c5fd775311ca'} Sep 27 16:42:05.562046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:42:05.562046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:42:05.562046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 27 16:42:05.562046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 27 16:42:05.562046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 16:42:05.562046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 16:42:05.562046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 27 16:42:05.562046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 27 16:42:05.562046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0ea51b63-250a-46c9-89d9-c5fd775311ca. Sep 27 16:42:05.562046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:42:05.562046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:42:05.562046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:42:05.562046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:42:05.562046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:42:05.562046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:42:05.562046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:42:05.562046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:42:05.562046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:42:05.563669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:42:05.563669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 27 16:42:05.563669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 27 16:42:05.563669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54bed735-4766-4b93-9db9-4c3731eec6c7 is not attached to volume 0ea51b63-250a-46c9-89d9-c5fd775311ca Sep 27 16:42:05.563669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:42:05.563669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:42:05.563669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:42:05.563669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:42:05.563669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:42:05.563669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:42:05.563669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:42:05.563669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:42:05.563669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54bed735-4766-4b93-9db9-4c3731eec6c7 is not attached to volume 0ea51b63-250a-46c9-89d9-c5fd775311ca Sep 27 16:42:05.563669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:42:05.563669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c607e1ff-b0bf-47e9-ac3b-109c64d8b4db tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Returning 404 to user: Instance 54bed735-4766-4b93-9db9-4c3731eec6c7 is not attached to volume 0ea51b63-250a-46c9-89d9-c5fd775311ca {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:42:05.565300 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c607e1ff-b0bf-47e9-ac3b-109c64d8b4db tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "DELETE /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7/os-volume_attachments/0ea51b63-250a-46c9-89d9-c5fd775311ca" status: 404 len: 154 microversion: 2.1 time: 0.105775 Sep 27 16:42:05.566584 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 343/720] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Sep 27 16:42:05 2022] DELETE /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7/os-volume_attachments/0ea51b63-250a-46c9-89d9-c5fd775311ca => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 16:42:05.727975 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f35eee24-7099-4d1f-9e50-b1d5f163d83f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:05.728478 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f35eee24-7099-4d1f-9e50-b1d5f163d83f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:05.734289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f35eee24-7099-4d1f-9e50-b1d5f163d83f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:05.734766 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f35eee24-7099-4d1f-9e50-b1d5f163d83f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:05.735236 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f35eee24-7099-4d1f-9e50-b1d5f163d83f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:05.735920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f35eee24-7099-4d1f-9e50-b1d5f163d83f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:05.736482 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f35eee24-7099-4d1f-9e50-b1d5f163d83f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:05.736788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f35eee24-7099-4d1f-9e50-b1d5f163d83f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:05.763780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f35eee24-7099-4d1f-9e50-b1d5f163d83f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac/ips" status: 200 len: 152 microversion: 2.20 time: 0.141047 Sep 27 16:42:05.764589 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 378/721] 10.222.0.64 () {60 vars in 1289 bytes} [Tue Sep 27 16:42:05 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac/ips => generated 152 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 16:42:06.353698 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-87c10b08-5739-4461-ba64-80148cd2ad54 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:06.354486 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-87c10b08-5739-4461-ba64-80148cd2ad54 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:06.361684 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87c10b08-5739-4461-ba64-80148cd2ad54 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:06.362258 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87c10b08-5739-4461-ba64-80148cd2ad54 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:06.362690 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87c10b08-5739-4461-ba64-80148cd2ad54 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:06.363477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87c10b08-5739-4461-ba64-80148cd2ad54 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:06.364466 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87c10b08-5739-4461-ba64-80148cd2ad54 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:06.364988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87c10b08-5739-4461-ba64-80148cd2ad54 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:06.497349 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-87c10b08-5739-4461-ba64-80148cd2ad54 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:06.506256 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-87c10b08-5739-4461-ba64-80148cd2ad54 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4" status: 200 len: 1366 microversion: 2.1 time: 0.156587 Sep 27 16:42:06.506821 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 344/722] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:06 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:06.842265 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8e097098-0d41-4e0e-a784-208615a72623 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:06.842908 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8e097098-0d41-4e0e-a784-208615a72623 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:06.850337 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e097098-0d41-4e0e-a784-208615a72623 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:06.851139 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e097098-0d41-4e0e-a784-208615a72623 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:06.851643 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e097098-0d41-4e0e-a784-208615a72623 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:06.852434 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e097098-0d41-4e0e-a784-208615a72623 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:06.852969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e097098-0d41-4e0e-a784-208615a72623 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:06.853572 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e097098-0d41-4e0e-a784-208615a72623 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:06.880903 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8e097098-0d41-4e0e-a784-208615a72623 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 16:42:06.899008 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:07.133025 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8e097098-0d41-4e0e-a784-208615a72623 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "DELETE /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 204 len: 0 microversion: 2.1 time: 0.294655 Sep 27 16:42:07.133620 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 379/723] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:42:06 2022] DELETE /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 16:42:07.142351 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9a7b1f16-8dd3-45e0-9482-0cc3c846b1da tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:07.143659 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9a7b1f16-8dd3-45e0-9482-0cc3c846b1da tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:07.150339 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a7b1f16-8dd3-45e0-9482-0cc3c846b1da tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:07.150855 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a7b1f16-8dd3-45e0-9482-0cc3c846b1da tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:07.156099 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a7b1f16-8dd3-45e0-9482-0cc3c846b1da tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:07.156099 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a7b1f16-8dd3-45e0-9482-0cc3c846b1da tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:07.156099 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a7b1f16-8dd3-45e0-9482-0cc3c846b1da tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:07.156099 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a7b1f16-8dd3-45e0-9482-0cc3c846b1da tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:07.286715 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9a7b1f16-8dd3-45e0-9482-0cc3c846b1da tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:07.294465 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9a7b1f16-8dd3-45e0-9482-0cc3c846b1da tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1555 microversion: 2.1 time: 0.156420 Sep 27 16:42:07.295048 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 345/724] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:07 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:07.530219 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a526a9c0-6c8a-4656-a236-d385eeeb0090 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:07.531209 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a526a9c0-6c8a-4656-a236-d385eeeb0090 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:07.537164 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a526a9c0-6c8a-4656-a236-d385eeeb0090 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:07.537574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a526a9c0-6c8a-4656-a236-d385eeeb0090 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:07.538004 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a526a9c0-6c8a-4656-a236-d385eeeb0090 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:07.538684 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a526a9c0-6c8a-4656-a236-d385eeeb0090 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:07.539159 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a526a9c0-6c8a-4656-a236-d385eeeb0090 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:07.539579 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a526a9c0-6c8a-4656-a236-d385eeeb0090 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:07.667729 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a526a9c0-6c8a-4656-a236-d385eeeb0090 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:07.675415 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a526a9c0-6c8a-4656-a236-d385eeeb0090 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4" status: 200 len: 1366 microversion: 2.1 time: 0.149385 Sep 27 16:42:07.675983 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 380/725] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:07 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:08.015256 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ebe3d5e1-e57c-406b-91b7-1c15451bc368 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:42:08.015803 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ebe3d5e1-e57c-406b-91b7-1c15451bc368 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:08.022217 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebe3d5e1-e57c-406b-91b7-1c15451bc368 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:08.022696 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebe3d5e1-e57c-406b-91b7-1c15451bc368 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:08.023153 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebe3d5e1-e57c-406b-91b7-1c15451bc368 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:08.023831 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebe3d5e1-e57c-406b-91b7-1c15451bc368 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:08.024278 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebe3d5e1-e57c-406b-91b7-1c15451bc368 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:08.024696 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebe3d5e1-e57c-406b-91b7-1c15451bc368 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:08.049245 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-ebe3d5e1-e57c-406b-91b7-1c15451bc368 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lazy-loading 'flavor' on Instance uuid 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:42:08.319918 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7da272a0-b216-4e09-98eb-7e26bcfc3ddf tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:08.320459 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7da272a0-b216-4e09-98eb-7e26bcfc3ddf tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:08.326564 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7da272a0-b216-4e09-98eb-7e26bcfc3ddf tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:08.327080 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7da272a0-b216-4e09-98eb-7e26bcfc3ddf tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:08.327516 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7da272a0-b216-4e09-98eb-7e26bcfc3ddf tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:08.328207 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7da272a0-b216-4e09-98eb-7e26bcfc3ddf tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:08.328663 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7da272a0-b216-4e09-98eb-7e26bcfc3ddf tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:08.329083 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7da272a0-b216-4e09-98eb-7e26bcfc3ddf tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:08.462569 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7da272a0-b216-4e09-98eb-7e26bcfc3ddf tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:08.470194 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7da272a0-b216-4e09-98eb-7e26bcfc3ddf tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1555 microversion: 2.1 time: 0.154500 Sep 27 16:42:08.470760 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 381/726] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:08 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:08.508723 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ebe3d5e1-e57c-406b-91b7-1c15451bc368 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "POST /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac/action" status: 202 len: 0 microversion: 2.20 time: 0.497191 Sep 27 16:42:08.509481 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 346/727] 10.222.0.64 () {62 vars in 1319 bytes} [Tue Sep 27 16:42:08 2022] POST /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 16:42:08.517451 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3af4774e-452b-4df8-8408-5d5ff3c671a0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:08.518057 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3af4774e-452b-4df8-8408-5d5ff3c671a0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:08.523949 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3af4774e-452b-4df8-8408-5d5ff3c671a0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:08.524449 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3af4774e-452b-4df8-8408-5d5ff3c671a0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:08.524863 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3af4774e-452b-4df8-8408-5d5ff3c671a0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:08.525564 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3af4774e-452b-4df8-8408-5d5ff3c671a0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:08.526015 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3af4774e-452b-4df8-8408-5d5ff3c671a0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:08.526440 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3af4774e-452b-4df8-8408-5d5ff3c671a0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:08.661946 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3af4774e-452b-4df8-8408-5d5ff3c671a0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:08.670013 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3af4774e-452b-4df8-8408-5d5ff3c671a0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:08.671491 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3af4774e-452b-4df8-8408-5d5ff3c671a0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:08.672642 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3af4774e-452b-4df8-8408-5d5ff3c671a0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1724 microversion: 2.20 time: 0.159022 Sep 27 16:42:08.673197 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 382/728] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:08 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:08.699970 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-897d310e-4bdb-45c2-a25b-29508fa00fd1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:08.700918 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-897d310e-4bdb-45c2-a25b-29508fa00fd1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:08.714886 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-897d310e-4bdb-45c2-a25b-29508fa00fd1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:08.714886 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-897d310e-4bdb-45c2-a25b-29508fa00fd1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:08.714886 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-897d310e-4bdb-45c2-a25b-29508fa00fd1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:08.714886 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-897d310e-4bdb-45c2-a25b-29508fa00fd1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:08.715289 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-897d310e-4bdb-45c2-a25b-29508fa00fd1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:08.715289 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-897d310e-4bdb-45c2-a25b-29508fa00fd1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:08.847357 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-897d310e-4bdb-45c2-a25b-29508fa00fd1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:08.856299 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-897d310e-4bdb-45c2-a25b-29508fa00fd1 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4" status: 200 len: 1366 microversion: 2.1 time: 0.161113 Sep 27 16:42:08.856805 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 347/729] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:08 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:09.087074 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-a0da8f81-359e-4768-9096-2b5a94c67953 req-94ca6ed7-9cea-48d8-bef3-61a1d9636036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "742a4313-504c-4882-8811-aafcac933bf4", "name": "network-vif-plugged", "status": "completed", "tag": "cf0033be-5776-4a8f-b33f-08ea7fc21985"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:42:09.096708 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-a0da8f81-359e-4768-9096-2b5a94c67953 req-94ca6ed7-9cea-48d8-bef3-61a1d9636036 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:09.097193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-a0da8f81-359e-4768-9096-2b5a94c67953 req-94ca6ed7-9cea-48d8-bef3-61a1d9636036 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:09.097632 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-a0da8f81-359e-4768-9096-2b5a94c67953 req-94ca6ed7-9cea-48d8-bef3-61a1d9636036 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:09.112598 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-a0da8f81-359e-4768-9096-2b5a94c67953 req-94ca6ed7-9cea-48d8-bef3-61a1d9636036 service nova] Creating event network-vif-plugged:cf0033be-5776-4a8f-b33f-08ea7fc21985 for instance 742a4313-504c-4882-8811-aafcac933bf4 on hv-cinder-85506 Sep 27 16:42:09.114720 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-a0da8f81-359e-4768-9096-2b5a94c67953 req-94ca6ed7-9cea-48d8-bef3-61a1d9636036 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085141 Sep 27 16:42:09.115531 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 383/730] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:42:09.493780 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c3982950-cda2-4c55-b0bc-d08647236dcd tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:09.494386 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c3982950-cda2-4c55-b0bc-d08647236dcd tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:09.500719 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3982950-cda2-4c55-b0bc-d08647236dcd tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:09.501203 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3982950-cda2-4c55-b0bc-d08647236dcd tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:09.501632 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3982950-cda2-4c55-b0bc-d08647236dcd tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:09.502349 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3982950-cda2-4c55-b0bc-d08647236dcd tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:09.504354 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3982950-cda2-4c55-b0bc-d08647236dcd tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:09.504354 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3982950-cda2-4c55-b0bc-d08647236dcd tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:09.646847 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c3982950-cda2-4c55-b0bc-d08647236dcd tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:09.657004 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c3982950-cda2-4c55-b0bc-d08647236dcd tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1555 microversion: 2.1 time: 0.167083 Sep 27 16:42:09.657814 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 348/731] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:09 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:09.687370 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-262bcea4-3b27-4c84-bba7-3aa795a8a62d req-ddb06320-8a63-4c00-a092-6e7b4a483600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54bed735-4766-4b93-9db9-4c3731eec6c7", "name": "network-vif-deleted", "tag": "95614818-7cd1-4590-9696-e7a8c3f6a751"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:42:09.697884 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8ae8179f-0e09-4aa6-869e-f6a7b97c306a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:09.698161 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-262bcea4-3b27-4c84-bba7-3aa795a8a62d req-ddb06320-8a63-4c00-a092-6e7b4a483600 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:09.698490 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8ae8179f-0e09-4aa6-869e-f6a7b97c306a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:09.698628 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-262bcea4-3b27-4c84-bba7-3aa795a8a62d req-ddb06320-8a63-4c00-a092-6e7b4a483600 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:09.699100 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-262bcea4-3b27-4c84-bba7-3aa795a8a62d req-ddb06320-8a63-4c00-a092-6e7b4a483600 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:09.704772 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ae8179f-0e09-4aa6-869e-f6a7b97c306a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:09.705354 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ae8179f-0e09-4aa6-869e-f6a7b97c306a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:09.705843 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ae8179f-0e09-4aa6-869e-f6a7b97c306a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:09.707785 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ae8179f-0e09-4aa6-869e-f6a7b97c306a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:09.707785 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ae8179f-0e09-4aa6-869e-f6a7b97c306a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:09.707785 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ae8179f-0e09-4aa6-869e-f6a7b97c306a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:09.710636 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-262bcea4-3b27-4c84-bba7-3aa795a8a62d req-ddb06320-8a63-4c00-a092-6e7b4a483600 service nova] Creating event network-vif-deleted:95614818-7cd1-4590-9696-e7a8c3f6a751 for instance 54bed735-4766-4b93-9db9-4c3731eec6c7 on hv-cinder-85506 Sep 27 16:42:09.715592 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-262bcea4-3b27-4c84-bba7-3aa795a8a62d req-ddb06320-8a63-4c00-a092-6e7b4a483600 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032248 Sep 27 16:42:09.716183 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 384/732] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:42:09.842462 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8ae8179f-0e09-4aa6-869e-f6a7b97c306a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:09.851408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8ae8179f-0e09-4aa6-869e-f6a7b97c306a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:09.852842 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8ae8179f-0e09-4aa6-869e-f6a7b97c306a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:09.853988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8ae8179f-0e09-4aa6-869e-f6a7b97c306a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1724 microversion: 2.20 time: 0.160060 Sep 27 16:42:09.854547 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 349/733] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:09 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:42:09.879714 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-670322e1-c2f1-4146-bce1-eb9f71f77acd tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:09.880627 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-670322e1-c2f1-4146-bce1-eb9f71f77acd tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:09.886677 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-670322e1-c2f1-4146-bce1-eb9f71f77acd tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:09.887220 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-670322e1-c2f1-4146-bce1-eb9f71f77acd tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:09.887636 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-670322e1-c2f1-4146-bce1-eb9f71f77acd tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:09.888326 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-670322e1-c2f1-4146-bce1-eb9f71f77acd tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:09.888782 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-670322e1-c2f1-4146-bce1-eb9f71f77acd tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:09.889210 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-670322e1-c2f1-4146-bce1-eb9f71f77acd tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:10.029814 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-670322e1-c2f1-4146-bce1-eb9f71f77acd tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:10.038553 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-670322e1-c2f1-4146-bce1-eb9f71f77acd tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4" status: 200 len: 1366 microversion: 2.1 time: 0.163308 Sep 27 16:42:10.046867 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 385/734] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:09 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:10.682611 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-929f3c5e-4fa5-4eca-b3ec-12f6287a99ab tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:10.683256 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-929f3c5e-4fa5-4eca-b3ec-12f6287a99ab tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:10.686616 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=6 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:10.690107 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-929f3c5e-4fa5-4eca-b3ec-12f6287a99ab tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:10.690589 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-929f3c5e-4fa5-4eca-b3ec-12f6287a99ab tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:10.696165 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-929f3c5e-4fa5-4eca-b3ec-12f6287a99ab tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:10.696165 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-929f3c5e-4fa5-4eca-b3ec-12f6287a99ab tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:10.696165 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-929f3c5e-4fa5-4eca-b3ec-12f6287a99ab tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:10.696165 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-929f3c5e-4fa5-4eca-b3ec-12f6287a99ab tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:10.724683 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-929f3c5e-4fa5-4eca-b3ec-12f6287a99ab tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:10.725357 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-929f3c5e-4fa5-4eca-b3ec-12f6287a99ab tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:10.726014 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-929f3c5e-4fa5-4eca-b3ec-12f6287a99ab tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:10.726475 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-929f3c5e-4fa5-4eca-b3ec-12f6287a99ab tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lazy-loading 'fault' on Instance uuid 54bed735-4766-4b93-9db9-4c3731eec6c7 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:42:10.768654 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-929f3c5e-4fa5-4eca-b3ec-12f6287a99ab tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '978e8037ce1d4742abe66ea12d660479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fb5144fbf64abe8ec6b37c7f0444b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:10.777546 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-929f3c5e-4fa5-4eca-b3ec-12f6287a99ab tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 200 len: 1348 microversion: 2.1 time: 0.098844 Sep 27 16:42:10.778116 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 350/735] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:10 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 1348 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:10.881275 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a1a4e4cb-fe44-49c9-9f8f-fa37675cdc82 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:10.881819 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a1a4e4cb-fe44-49c9-9f8f-fa37675cdc82 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:10.883797 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:10.884450 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=6 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:10.889246 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a1a4e4cb-fe44-49c9-9f8f-fa37675cdc82 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:10.889733 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a1a4e4cb-fe44-49c9-9f8f-fa37675cdc82 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:10.890175 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a1a4e4cb-fe44-49c9-9f8f-fa37675cdc82 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:10.890901 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a1a4e4cb-fe44-49c9-9f8f-fa37675cdc82 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:10.891375 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a1a4e4cb-fe44-49c9-9f8f-fa37675cdc82 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:10.891799 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a1a4e4cb-fe44-49c9-9f8f-fa37675cdc82 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:11.025969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a1a4e4cb-fe44-49c9-9f8f-fa37675cdc82 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:11.034315 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a1a4e4cb-fe44-49c9-9f8f-fa37675cdc82 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:11.035932 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a1a4e4cb-fe44-49c9-9f8f-fa37675cdc82 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:11.037095 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a1a4e4cb-fe44-49c9-9f8f-fa37675cdc82 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1724 microversion: 2.20 time: 0.160542 Sep 27 16:42:11.037672 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 386/736] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:10 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:11.062734 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8f6f910e-34ab-4239-ab2d-57dbc898e2d6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:11.063365 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8f6f910e-34ab-4239-ab2d-57dbc898e2d6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:11.069825 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f6f910e-34ab-4239-ab2d-57dbc898e2d6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:11.070299 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f6f910e-34ab-4239-ab2d-57dbc898e2d6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:11.070727 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f6f910e-34ab-4239-ab2d-57dbc898e2d6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:11.071437 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f6f910e-34ab-4239-ab2d-57dbc898e2d6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:11.071885 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f6f910e-34ab-4239-ab2d-57dbc898e2d6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:11.072303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f6f910e-34ab-4239-ab2d-57dbc898e2d6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:11.208436 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8f6f910e-34ab-4239-ab2d-57dbc898e2d6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:11.216145 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8f6f910e-34ab-4239-ab2d-57dbc898e2d6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4" status: 200 len: 1555 microversion: 2.1 time: 0.157369 Sep 27 16:42:11.216710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 351/737] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:11 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:11.240423 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-85422d64-8ca5-45cc-a258-64864356d55a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:11.240917 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-85422d64-8ca5-45cc-a258-64864356d55a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:11.247061 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85422d64-8ca5-45cc-a258-64864356d55a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:11.247539 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85422d64-8ca5-45cc-a258-64864356d55a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:11.247965 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85422d64-8ca5-45cc-a258-64864356d55a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:11.248682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85422d64-8ca5-45cc-a258-64864356d55a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:11.249247 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85422d64-8ca5-45cc-a258-64864356d55a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:11.249671 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85422d64-8ca5-45cc-a258-64864356d55a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:11.327102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-85422d64-8ca5-45cc-a258-64864356d55a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090542 Sep 27 16:42:11.327691 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 387/738] 10.222.0.64 () {58 vars in 1275 bytes} [Tue Sep 27 16:42:11 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:42:11.804775 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fc1733b1-9123-42f5-bc7d-31b4a3e9d8c1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:11.805396 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fc1733b1-9123-42f5-bc7d-31b4a3e9d8c1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] [instance: 54bed735-4766-4b93-9db9-4c3731eec6c7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:11.811603 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc1733b1-9123-42f5-bc7d-31b4a3e9d8c1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:11.812095 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc1733b1-9123-42f5-bc7d-31b4a3e9d8c1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:11.812533 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc1733b1-9123-42f5-bc7d-31b4a3e9d8c1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:11.813242 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc1733b1-9123-42f5-bc7d-31b4a3e9d8c1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:11.813731 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc1733b1-9123-42f5-bc7d-31b4a3e9d8c1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:11.814158 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc1733b1-9123-42f5-bc7d-31b4a3e9d8c1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:11.837289 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-fc1733b1-9123-42f5-bc7d-31b4a3e9d8c1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] HTTP exception thrown: Instance 54bed735-4766-4b93-9db9-4c3731eec6c7 could not be found. Sep 27 16:42:11.838988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fc1733b1-9123-42f5-bc7d-31b4a3e9d8c1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Request method failure captured: Sep 27 16:42:11.838988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 HTTP/1.1 Sep 27 16:42:11.838988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:42:11.838988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:42:11.838988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:42:11.838988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 27 16:42:11.838988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:42:11.838988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:42:11.838988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:42:11.838988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:42:11.838988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMyb6Xqea6g748Vc21dWHHjRVZm-FB6s3tkeI4qOAFf4xjwqbrdwDzg60KU8tx_nLSXa942xNmUwH2FI1dtCFQgt6qPyMYzOVZuwSfxwPtmzVfkw_nadP-KXMeqA_NRcu1fnEIkG5CXrzrXXDrE3zB3Op3OMnNIbW-V6jCtS4FzLg7NI Sep 27 16:42:11.838988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:42:11.838988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:42:11.838988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:42:11.838988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:42:11.838988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:42:11.838988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:42:11.838988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: d5fb5144fbf64abe8ec6b37c7f0444b3 Sep 27 16:42:11.838988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-TestMinimumBasicScenario-227384981 Sep 27 16:42:11.838988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:42:11.838988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:42:11.841062 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d5fb5144fbf64abe8ec6b37c7f0444b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d5fb5144fbf64abe8ec6b37c7f0444b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d5fb5144fbf64abe8ec6b37c7f0444b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d5fb5144fbf64abe8ec6b37c7f0444b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:42:11.841062 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-TestMinimumBasicScenario-227384981 Sep 27 16:42:11.841062 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: d5fb5144fbf64abe8ec6b37c7f0444b3 Sep 27 16:42:11.841062 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-TestMinimumBasicScenario-227384981 Sep 27 16:42:11.841062 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-TestMinimumBasicScenario-227384981-project Sep 27 16:42:11.841062 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:42:11.841062 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:42:11.841062 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: 978e8037ce1d4742abe66ea12d660479 Sep 27 16:42:11.841062 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-TestMinimumBasicScenario-227384981-project Sep 27 16:42:11.841062 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: > Sep 27 16:42:11.841062 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Instance 54bed735-4766-4b93-9db9-4c3731eec6c7 could not be found. Sep 27 16:42:11.841062 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'id': '54bed735-4766-4b93-9db9-4c3731eec6c7'} Sep 27 16:42:11.842160 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:42:11.842160 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:42:11.842160 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:42:11.842160 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:42:11.842160 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:42:11.842160 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:42:11.842160 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:42:11.842160 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:42:11.842160 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:42:11.842160 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:42:11.842160 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54bed735-4766-4b93-9db9-4c3731eec6c7 could not be found. Sep 27 16:42:11.842160 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:42:11.842160 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:42:11.842160 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:42:11.842160 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:42:11.842160 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:42:11.842160 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:42:11.842160 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:42:11.842160 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:42:11.842160 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:42:11.843614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:42:11.843614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:42:11.843614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:42:11.843614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:42:11.843614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:42:11.843614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:42:11.843614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:42:11.843614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54bed735-4766-4b93-9db9-4c3731eec6c7 could not be found. Sep 27 16:42:11.843614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:42:11.843614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:42:11.843614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:42:11.843614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:42:11.843614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:42:11.843614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:42:11.843614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:42:11.843614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:42:11.843614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54bed735-4766-4b93-9db9-4c3731eec6c7 could not be found. Sep 27 16:42:11.843614 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:42:11.844988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fc1733b1-9123-42f5-bc7d-31b4a3e9d8c1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Returning 404 to user: Instance 54bed735-4766-4b93-9db9-4c3731eec6c7 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:42:11.844988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fc1733b1-9123-42f5-bc7d-31b4a3e9d8c1 tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7" status: 404 len: 111 microversion: 2.1 time: 0.040727 Sep 27 16:42:11.844988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 352/739] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:11 2022] GET /compute/v2.1/servers/54bed735-4766-4b93-9db9-4c3731eec6c7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:42:11.849924 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-edbda885-0270-4c06-a38d-d05d6f49da4b tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] Calling method '.version_select at 0x7fa4059af4c0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:12.009012 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-edbda885-0270-4c06-a38d-d05d6f49da4b tempest-TestMinimumBasicScenario-227384981 tempest-TestMinimumBasicScenario-227384981-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-221901116" status: 202 len: 0 microversion: 2.1 time: 0.162878 Sep 27 16:42:12.009726 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 388/740] 10.222.0.64 () {58 vars in 1269 bytes} [Tue Sep 27 16:42:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-221901116 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:42:12.061604 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8536b614-2fd8-4758-ba01-f372d48fabd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:12.062248 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8536b614-2fd8-4758-ba01-f372d48fabd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:12.072281 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8536b614-2fd8-4758-ba01-f372d48fabd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:12.072783 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8536b614-2fd8-4758-ba01-f372d48fabd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:12.073250 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8536b614-2fd8-4758-ba01-f372d48fabd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:12.073973 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8536b614-2fd8-4758-ba01-f372d48fabd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:12.074429 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8536b614-2fd8-4758-ba01-f372d48fabd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:12.074897 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8536b614-2fd8-4758-ba01-f372d48fabd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:12.308785 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8536b614-2fd8-4758-ba01-f372d48fabd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:12.318401 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8536b614-2fd8-4758-ba01-f372d48fabd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:12.320009 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8536b614-2fd8-4758-ba01-f372d48fabd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:12.321192 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8536b614-2fd8-4758-ba01-f372d48fabd8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1724 microversion: 2.20 time: 0.263596 Sep 27 16:42:12.321936 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 353/741] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:12 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:12.472245 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-90d2d9f4-ef6f-402d-b4d2-324d91907362 req-a97e3269-7bb2-4b69-953c-2564bb88fc6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "742a4313-504c-4882-8811-aafcac933bf4", "tag": "cf0033be-5776-4a8f-b33f-08ea7fc21985"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:42:12.481685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-90d2d9f4-ef6f-402d-b4d2-324d91907362 req-a97e3269-7bb2-4b69-953c-2564bb88fc6d service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:12.482176 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-90d2d9f4-ef6f-402d-b4d2-324d91907362 req-a97e3269-7bb2-4b69-953c-2564bb88fc6d service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:12.482815 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-90d2d9f4-ef6f-402d-b4d2-324d91907362 req-a97e3269-7bb2-4b69-953c-2564bb88fc6d service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:12.495432 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-90d2d9f4-ef6f-402d-b4d2-324d91907362 req-a97e3269-7bb2-4b69-953c-2564bb88fc6d service nova] Creating event network-changed:cf0033be-5776-4a8f-b33f-08ea7fc21985 for instance 742a4313-504c-4882-8811-aafcac933bf4 on hv-cinder-85506 Sep 27 16:42:12.500739 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-90d2d9f4-ef6f-402d-b4d2-324d91907362 req-a97e3269-7bb2-4b69-953c-2564bb88fc6d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032083 Sep 27 16:42:12.501465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 389/742] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:42:13.348058 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cbf369d6-3429-49d6-9394-3af2c8046e27 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:13.349417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cbf369d6-3429-49d6-9394-3af2c8046e27 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:13.356363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cbf369d6-3429-49d6-9394-3af2c8046e27 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:13.357196 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cbf369d6-3429-49d6-9394-3af2c8046e27 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:13.357447 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cbf369d6-3429-49d6-9394-3af2c8046e27 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:13.357982 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cbf369d6-3429-49d6-9394-3af2c8046e27 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:13.358434 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cbf369d6-3429-49d6-9394-3af2c8046e27 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:13.358925 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cbf369d6-3429-49d6-9394-3af2c8046e27 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:13.505983 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-cbf369d6-3429-49d6-9394-3af2c8046e27 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:13.516044 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-cbf369d6-3429-49d6-9394-3af2c8046e27 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:13.517724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-cbf369d6-3429-49d6-9394-3af2c8046e27 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:13.520359 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-cbf369d6-3429-49d6-9394-3af2c8046e27 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1724 microversion: 2.20 time: 0.175131 Sep 27 16:42:13.520960 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 354/743] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:13 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:14.546350 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-92d8fc10-e809-4afc-b590-e42f7b6469c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:14.547086 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-92d8fc10-e809-4afc-b590-e42f7b6469c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:14.554572 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92d8fc10-e809-4afc-b590-e42f7b6469c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:14.555095 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92d8fc10-e809-4afc-b590-e42f7b6469c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:14.555539 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92d8fc10-e809-4afc-b590-e42f7b6469c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:14.556305 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92d8fc10-e809-4afc-b590-e42f7b6469c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:14.556759 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92d8fc10-e809-4afc-b590-e42f7b6469c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:14.557181 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-92d8fc10-e809-4afc-b590-e42f7b6469c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:14.701480 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-92d8fc10-e809-4afc-b590-e42f7b6469c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:14.711436 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-92d8fc10-e809-4afc-b590-e42f7b6469c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:14.712945 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-92d8fc10-e809-4afc-b590-e42f7b6469c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:14.714113 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-92d8fc10-e809-4afc-b590-e42f7b6469c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1724 microversion: 2.20 time: 0.172247 Sep 27 16:42:14.714672 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 390/744] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:14 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:15.740736 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-49f7c3f5-b3e3-4e95-8e43-1b552a85a3a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:15.741372 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-49f7c3f5-b3e3-4e95-8e43-1b552a85a3a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:15.747978 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49f7c3f5-b3e3-4e95-8e43-1b552a85a3a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:15.750689 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49f7c3f5-b3e3-4e95-8e43-1b552a85a3a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:15.750689 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49f7c3f5-b3e3-4e95-8e43-1b552a85a3a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:15.750689 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49f7c3f5-b3e3-4e95-8e43-1b552a85a3a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:15.750689 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49f7c3f5-b3e3-4e95-8e43-1b552a85a3a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:15.751138 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49f7c3f5-b3e3-4e95-8e43-1b552a85a3a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:15.887841 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-49f7c3f5-b3e3-4e95-8e43-1b552a85a3a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:15.905069 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-49f7c3f5-b3e3-4e95-8e43-1b552a85a3a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:15.907933 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-49f7c3f5-b3e3-4e95-8e43-1b552a85a3a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:15.910149 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-49f7c3f5-b3e3-4e95-8e43-1b552a85a3a6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1724 microversion: 2.20 time: 0.174136 Sep 27 16:42:15.924209 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 355/745] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:15 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:42:16.935889 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8507d2a1-1719-4282-8b70-d4b4ef6a17fd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:16.937195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8507d2a1-1719-4282-8b70-d4b4ef6a17fd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:16.942983 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:16.948712 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8507d2a1-1719-4282-8b70-d4b4ef6a17fd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:16.948712 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8507d2a1-1719-4282-8b70-d4b4ef6a17fd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:16.948712 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8507d2a1-1719-4282-8b70-d4b4ef6a17fd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:16.948712 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8507d2a1-1719-4282-8b70-d4b4ef6a17fd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:16.949769 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8507d2a1-1719-4282-8b70-d4b4ef6a17fd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:16.951359 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8507d2a1-1719-4282-8b70-d4b4ef6a17fd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:17.184548 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8507d2a1-1719-4282-8b70-d4b4ef6a17fd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:17.194479 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8507d2a1-1719-4282-8b70-d4b4ef6a17fd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:17.195983 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8507d2a1-1719-4282-8b70-d4b4ef6a17fd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:17.197161 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8507d2a1-1719-4282-8b70-d4b4ef6a17fd tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1724 microversion: 2.20 time: 0.265325 Sep 27 16:42:17.197951 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 391/746] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:16 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:18.222344 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-39c48a9a-99bd-402e-8919-8ae8f1f968a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:18.222971 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-39c48a9a-99bd-402e-8919-8ae8f1f968a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:18.229670 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-39c48a9a-99bd-402e-8919-8ae8f1f968a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:18.230153 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-39c48a9a-99bd-402e-8919-8ae8f1f968a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:18.230606 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-39c48a9a-99bd-402e-8919-8ae8f1f968a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:18.231337 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-39c48a9a-99bd-402e-8919-8ae8f1f968a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:18.231836 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-39c48a9a-99bd-402e-8919-8ae8f1f968a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:18.234724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-39c48a9a-99bd-402e-8919-8ae8f1f968a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:18.393818 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-39c48a9a-99bd-402e-8919-8ae8f1f968a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:18.405325 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-39c48a9a-99bd-402e-8919-8ae8f1f968a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:18.407242 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-39c48a9a-99bd-402e-8919-8ae8f1f968a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:18.408431 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-39c48a9a-99bd-402e-8919-8ae8f1f968a4 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1724 microversion: 2.20 time: 0.190056 Sep 27 16:42:18.409185 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 356/747] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:18 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:19.433410 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-970bbe2e-bad1-4afe-ae00-59124b8812f9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:19.434022 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-970bbe2e-bad1-4afe-ae00-59124b8812f9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:19.440033 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-970bbe2e-bad1-4afe-ae00-59124b8812f9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:19.440738 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-970bbe2e-bad1-4afe-ae00-59124b8812f9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:19.440978 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-970bbe2e-bad1-4afe-ae00-59124b8812f9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:19.441895 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-970bbe2e-bad1-4afe-ae00-59124b8812f9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:19.442458 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-970bbe2e-bad1-4afe-ae00-59124b8812f9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:19.442926 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-970bbe2e-bad1-4afe-ae00-59124b8812f9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:19.575015 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-970bbe2e-bad1-4afe-ae00-59124b8812f9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:19.588936 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-970bbe2e-bad1-4afe-ae00-59124b8812f9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:19.595013 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-970bbe2e-bad1-4afe-ae00-59124b8812f9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:19.595013 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-970bbe2e-bad1-4afe-ae00-59124b8812f9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1745 microversion: 2.20 time: 0.162752 Sep 27 16:42:19.610305 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 392/748] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:19 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:20.618105 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1a911191-b147-42c6-b5b1-d4ae8ef54b7d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:20.618718 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1a911191-b147-42c6-b5b1-d4ae8ef54b7d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:20.625553 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a911191-b147-42c6-b5b1-d4ae8ef54b7d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:20.626042 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a911191-b147-42c6-b5b1-d4ae8ef54b7d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:20.626475 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a911191-b147-42c6-b5b1-d4ae8ef54b7d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:20.627442 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a911191-b147-42c6-b5b1-d4ae8ef54b7d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:20.627879 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a911191-b147-42c6-b5b1-d4ae8ef54b7d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:20.628300 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1a911191-b147-42c6-b5b1-d4ae8ef54b7d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:20.766840 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1a911191-b147-42c6-b5b1-d4ae8ef54b7d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:20.776419 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1a911191-b147-42c6-b5b1-d4ae8ef54b7d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:20.777857 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1a911191-b147-42c6-b5b1-d4ae8ef54b7d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:20.779080 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1a911191-b147-42c6-b5b1-d4ae8ef54b7d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1745 microversion: 2.20 time: 0.165778 Sep 27 16:42:20.779647 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 357/749] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:20 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:21.806067 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-822a8fd0-15ea-4abd-8944-eed460e428c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:21.806664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-822a8fd0-15ea-4abd-8944-eed460e428c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:21.812701 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-822a8fd0-15ea-4abd-8944-eed460e428c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:21.813190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-822a8fd0-15ea-4abd-8944-eed460e428c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:21.813633 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-822a8fd0-15ea-4abd-8944-eed460e428c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:21.814324 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-822a8fd0-15ea-4abd-8944-eed460e428c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:21.814798 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-822a8fd0-15ea-4abd-8944-eed460e428c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:21.815229 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-822a8fd0-15ea-4abd-8944-eed460e428c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:21.948826 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-822a8fd0-15ea-4abd-8944-eed460e428c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:21.958503 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-822a8fd0-15ea-4abd-8944-eed460e428c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:21.960059 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-822a8fd0-15ea-4abd-8944-eed460e428c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:21.961282 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-822a8fd0-15ea-4abd-8944-eed460e428c0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1745 microversion: 2.20 time: 0.159127 Sep 27 16:42:21.962005 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 393/750] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:21 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:22.119725 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-40c7b542-8826-4325-892c-db728f450c01 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:22.120218 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-40c7b542-8826-4325-892c-db728f450c01 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:22.126585 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40c7b542-8826-4325-892c-db728f450c01 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:22.127118 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40c7b542-8826-4325-892c-db728f450c01 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:22.127543 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40c7b542-8826-4325-892c-db728f450c01 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:22.128227 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40c7b542-8826-4325-892c-db728f450c01 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:22.128693 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40c7b542-8826-4325-892c-db728f450c01 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:22.129159 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40c7b542-8826-4325-892c-db728f450c01 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:22.147379 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:22.212210 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-40c7b542-8826-4325-892c-db728f450c01 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lazy-loading 'services' on Instance uuid 18c68417-b41c-4ab3-9fac-9e7087bfe731 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:42:22.447520 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-40c7b542-8826-4325-892c-db728f450c01 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "DELETE /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731/os-volume_attachments/7b186cf2-52c0-437f-aa7f-f7e63901c4e7" status: 202 len: 0 microversion: 2.1 time: 0.331373 Sep 27 16:42:22.448219 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 358/751] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Sep 27 16:42:22 2022] DELETE /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731/os-volume_attachments/7b186cf2-52c0-437f-aa7f-f7e63901c4e7 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:42:22.458045 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9c561d37-7219-47a8-9803-efaafbbd916d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:22.460577 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9c561d37-7219-47a8-9803-efaafbbd916d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:22.467728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c561d37-7219-47a8-9803-efaafbbd916d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:22.468212 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c561d37-7219-47a8-9803-efaafbbd916d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:22.468848 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c561d37-7219-47a8-9803-efaafbbd916d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:22.469554 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c561d37-7219-47a8-9803-efaafbbd916d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:22.470007 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c561d37-7219-47a8-9803-efaafbbd916d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:22.470429 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c561d37-7219-47a8-9803-efaafbbd916d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:22.503057 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9c561d37-7219-47a8-9803-efaafbbd916d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049619 Sep 27 16:42:22.503622 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 394/752] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Sep 27 16:42:22 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:42:22.988192 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f024cd66-5af9-4dd8-884c-80f51671e39d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:22.989045 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f024cd66-5af9-4dd8-884c-80f51671e39d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:22.995456 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f024cd66-5af9-4dd8-884c-80f51671e39d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:23.004166 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f024cd66-5af9-4dd8-884c-80f51671e39d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:23.004166 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f024cd66-5af9-4dd8-884c-80f51671e39d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:23.004166 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f024cd66-5af9-4dd8-884c-80f51671e39d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:23.004166 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f024cd66-5af9-4dd8-884c-80f51671e39d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:23.004534 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f024cd66-5af9-4dd8-884c-80f51671e39d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:23.177981 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f024cd66-5af9-4dd8-884c-80f51671e39d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:23.188391 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f024cd66-5af9-4dd8-884c-80f51671e39d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:23.191494 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f024cd66-5af9-4dd8-884c-80f51671e39d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:23.193332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f024cd66-5af9-4dd8-884c-80f51671e39d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1740 microversion: 2.20 time: 0.209859 Sep 27 16:42:23.210652 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 359/753] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:22 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:23.516139 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-33d8b062-2cde-4e6f-9117-58923d11cb4f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:23.519326 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-33d8b062-2cde-4e6f-9117-58923d11cb4f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:23.529483 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-33d8b062-2cde-4e6f-9117-58923d11cb4f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:23.530344 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-33d8b062-2cde-4e6f-9117-58923d11cb4f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:23.531289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-33d8b062-2cde-4e6f-9117-58923d11cb4f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:23.532068 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-33d8b062-2cde-4e6f-9117-58923d11cb4f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:23.532593 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-33d8b062-2cde-4e6f-9117-58923d11cb4f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:23.533081 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-33d8b062-2cde-4e6f-9117-58923d11cb4f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:23.572403 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-33d8b062-2cde-4e6f-9117-58923d11cb4f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060320 Sep 27 16:42:23.579620 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 395/754] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Sep 27 16:42:23 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:42:24.223642 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b3774b88-b32f-4379-b1dd-e4c43a049591 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:24.226185 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b3774b88-b32f-4379-b1dd-e4c43a049591 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:24.234708 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b3774b88-b32f-4379-b1dd-e4c43a049591 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:24.235590 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b3774b88-b32f-4379-b1dd-e4c43a049591 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:24.236264 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b3774b88-b32f-4379-b1dd-e4c43a049591 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:24.237268 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b3774b88-b32f-4379-b1dd-e4c43a049591 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:24.237957 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b3774b88-b32f-4379-b1dd-e4c43a049591 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:24.238722 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b3774b88-b32f-4379-b1dd-e4c43a049591 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:24.458405 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b3774b88-b32f-4379-b1dd-e4c43a049591 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:24.482998 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b3774b88-b32f-4379-b1dd-e4c43a049591 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:24.492506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b3774b88-b32f-4379-b1dd-e4c43a049591 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:24.495155 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b3774b88-b32f-4379-b1dd-e4c43a049591 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1740 microversion: 2.20 time: 0.276613 Sep 27 16:42:24.496812 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 360/755] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:24 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1740 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:24.591344 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-51a380e9-0451-4f16-8273-0862bb8eec9a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:24.593641 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-51a380e9-0451-4f16-8273-0862bb8eec9a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:24.601196 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51a380e9-0451-4f16-8273-0862bb8eec9a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:24.601946 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51a380e9-0451-4f16-8273-0862bb8eec9a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:24.605670 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51a380e9-0451-4f16-8273-0862bb8eec9a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:24.605670 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51a380e9-0451-4f16-8273-0862bb8eec9a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:24.605670 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51a380e9-0451-4f16-8273-0862bb8eec9a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:24.605670 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51a380e9-0451-4f16-8273-0862bb8eec9a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:24.677353 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-51a380e9-0451-4f16-8273-0862bb8eec9a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090524 Sep 27 16:42:24.678956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 396/756] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Sep 27 16:42:24 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 16:42:24.815977 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b7fa594c-2f2b-4a74-bf9f-1e0a1cbfcff2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:24.817270 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b7fa594c-2f2b-4a74-bf9f-1e0a1cbfcff2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:24.831829 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7fa594c-2f2b-4a74-bf9f-1e0a1cbfcff2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:24.833207 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7fa594c-2f2b-4a74-bf9f-1e0a1cbfcff2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:24.834867 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7fa594c-2f2b-4a74-bf9f-1e0a1cbfcff2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:24.836210 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7fa594c-2f2b-4a74-bf9f-1e0a1cbfcff2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:24.837260 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7fa594c-2f2b-4a74-bf9f-1e0a1cbfcff2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:24.837838 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7fa594c-2f2b-4a74-bf9f-1e0a1cbfcff2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:24.878478 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b7fa594c-2f2b-4a74-bf9f-1e0a1cbfcff2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 16:42:25.070929 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-ab65da2a-5c38-4743-ae11-f2250d14ffe7 req-9c6ca778-79ac-4307-a02d-6b7d43e03ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac", "name": "network-vif-plugged", "status": "completed", "tag": "ddb6a707-22f0-4c10-adcc-9f4d5d262645"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:42:25.085122 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-ab65da2a-5c38-4743-ae11-f2250d14ffe7 req-9c6ca778-79ac-4307-a02d-6b7d43e03ea4 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:25.085962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-ab65da2a-5c38-4743-ae11-f2250d14ffe7 req-9c6ca778-79ac-4307-a02d-6b7d43e03ea4 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:25.090707 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-ab65da2a-5c38-4743-ae11-f2250d14ffe7 req-9c6ca778-79ac-4307-a02d-6b7d43e03ea4 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:25.099011 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-ab65da2a-5c38-4743-ae11-f2250d14ffe7 req-9c6ca778-79ac-4307-a02d-6b7d43e03ea4 service nova] Creating event network-vif-plugged:ddb6a707-22f0-4c10-adcc-9f4d5d262645 for instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac on hv-cinder-85506 Sep 27 16:42:25.105059 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-ab65da2a-5c38-4743-ae11-f2250d14ffe7 req-9c6ca778-79ac-4307-a02d-6b7d43e03ea4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038049 Sep 27 16:42:25.105653 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 397/757] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:42:25.272317 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b7fa594c-2f2b-4a74-bf9f-1e0a1cbfcff2 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "DELETE /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 204 len: 0 microversion: 2.1 time: 0.460244 Sep 27 16:42:25.273065 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 361/758] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:42:24 2022] DELETE /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 16:42:25.282422 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-524c9ab2-1026-47d3-a8a9-0d382ed3d6df tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:25.283179 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-524c9ab2-1026-47d3-a8a9-0d382ed3d6df tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:25.290967 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-524c9ab2-1026-47d3-a8a9-0d382ed3d6df tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:25.291705 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-524c9ab2-1026-47d3-a8a9-0d382ed3d6df tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:25.292366 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-524c9ab2-1026-47d3-a8a9-0d382ed3d6df tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:25.292924 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-524c9ab2-1026-47d3-a8a9-0d382ed3d6df tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:25.293596 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-524c9ab2-1026-47d3-a8a9-0d382ed3d6df tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:25.294247 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-524c9ab2-1026-47d3-a8a9-0d382ed3d6df tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:25.530045 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7f54015d-27e2-469c-9ab6-fc5223034160 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:25.532555 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7f54015d-27e2-469c-9ab6-fc5223034160 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:25.547139 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f54015d-27e2-469c-9ab6-fc5223034160 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:25.549073 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f54015d-27e2-469c-9ab6-fc5223034160 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:25.549878 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f54015d-27e2-469c-9ab6-fc5223034160 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:25.552425 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f54015d-27e2-469c-9ab6-fc5223034160 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:25.554222 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f54015d-27e2-469c-9ab6-fc5223034160 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:25.555154 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f54015d-27e2-469c-9ab6-fc5223034160 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:25.848800 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-524c9ab2-1026-47d3-a8a9-0d382ed3d6df tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:25.856931 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:25.862965 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-524c9ab2-1026-47d3-a8a9-0d382ed3d6df tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1687 microversion: 2.1 time: 0.585083 Sep 27 16:42:25.872167 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 398/759] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:25 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1687 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:42:25.902160 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7f54015d-27e2-469c-9ab6-fc5223034160 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:25.912087 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7f54015d-27e2-469c-9ab6-fc5223034160 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:25.913654 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7f54015d-27e2-469c-9ab6-fc5223034160 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:25.916560 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7f54015d-27e2-469c-9ab6-fc5223034160 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1740 microversion: 2.20 time: 0.391579 Sep 27 16:42:25.923136 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 362/760] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:25 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1740 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:42:26.890646 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8c671231-8e44-4cf2-b92f-bce95c191967 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:26.891920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8c671231-8e44-4cf2-b92f-bce95c191967 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:26.939134 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c671231-8e44-4cf2-b92f-bce95c191967 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:26.939902 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c671231-8e44-4cf2-b92f-bce95c191967 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:26.944116 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5124e363-464a-49be-b708-84403f11cb0d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:26.945245 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5124e363-464a-49be-b708-84403f11cb0d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:26.949271 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c671231-8e44-4cf2-b92f-bce95c191967 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:26.952986 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c671231-8e44-4cf2-b92f-bce95c191967 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:26.952986 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c671231-8e44-4cf2-b92f-bce95c191967 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:26.952986 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c671231-8e44-4cf2-b92f-bce95c191967 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:26.955106 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5124e363-464a-49be-b708-84403f11cb0d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:26.955596 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5124e363-464a-49be-b708-84403f11cb0d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:26.956029 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5124e363-464a-49be-b708-84403f11cb0d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:26.956732 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5124e363-464a-49be-b708-84403f11cb0d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:26.957213 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5124e363-464a-49be-b708-84403f11cb0d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:26.966282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5124e363-464a-49be-b708-84403f11cb0d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:27.265664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8c671231-8e44-4cf2-b92f-bce95c191967 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:27.275454 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8c671231-8e44-4cf2-b92f-bce95c191967 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1687 microversion: 2.1 time: 0.388858 Sep 27 16:42:27.291409 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5124e363-464a-49be-b708-84403f11cb0d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:27.292531 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 399/761] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:26 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1687 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:27.303744 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5124e363-464a-49be-b708-84403f11cb0d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:27.305820 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5124e363-464a-49be-b708-84403f11cb0d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:27.307374 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5124e363-464a-49be-b708-84403f11cb0d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1740 microversion: 2.20 time: 0.368284 Sep 27 16:42:27.308406 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 363/762] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:26 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1740 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:42:28.302890 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-681d798e-ccfc-4acc-8b9d-e13892f1b4a8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:28.304244 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-681d798e-ccfc-4acc-8b9d-e13892f1b4a8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:28.323153 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-681d798e-ccfc-4acc-8b9d-e13892f1b4a8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:28.324125 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-681d798e-ccfc-4acc-8b9d-e13892f1b4a8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:28.324789 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-681d798e-ccfc-4acc-8b9d-e13892f1b4a8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:28.325760 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-681d798e-ccfc-4acc-8b9d-e13892f1b4a8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:28.326459 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-681d798e-ccfc-4acc-8b9d-e13892f1b4a8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:28.327132 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-681d798e-ccfc-4acc-8b9d-e13892f1b4a8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:28.341227 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-26539727-26cf-4ed4-8e19-cafcc481298e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:28.343524 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-26539727-26cf-4ed4-8e19-cafcc481298e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:28.356931 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:28.366226 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26539727-26cf-4ed4-8e19-cafcc481298e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:28.367118 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26539727-26cf-4ed4-8e19-cafcc481298e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:28.367776 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26539727-26cf-4ed4-8e19-cafcc481298e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:28.368743 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26539727-26cf-4ed4-8e19-cafcc481298e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:28.369514 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26539727-26cf-4ed4-8e19-cafcc481298e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:28.370839 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26539727-26cf-4ed4-8e19-cafcc481298e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:28.751219 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-681d798e-ccfc-4acc-8b9d-e13892f1b4a8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:28.765242 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-26539727-26cf-4ed4-8e19-cafcc481298e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:28.778210 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-681d798e-ccfc-4acc-8b9d-e13892f1b4a8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1687 microversion: 2.1 time: 0.476107 Sep 27 16:42:28.778929 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 400/763] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:28 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1687 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:28.783999 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-26539727-26cf-4ed4-8e19-cafcc481298e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:28.796613 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-26539727-26cf-4ed4-8e19-cafcc481298e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:28.798713 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-26539727-26cf-4ed4-8e19-cafcc481298e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1740 microversion: 2.20 time: 0.463436 Sep 27 16:42:28.802729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 364/764] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:28 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1740 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:42:29.807034 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5ccc46df-c206-4de0-82bd-3679564d473a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:29.807682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5ccc46df-c206-4de0-82bd-3679564d473a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:29.830710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d5b7f781-2acf-4e99-8593-8734af54705c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:29.834968 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d5b7f781-2acf-4e99-8593-8734af54705c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:29.838388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ccc46df-c206-4de0-82bd-3679564d473a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:29.840604 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ccc46df-c206-4de0-82bd-3679564d473a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:29.841618 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ccc46df-c206-4de0-82bd-3679564d473a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:29.844385 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ccc46df-c206-4de0-82bd-3679564d473a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:29.844385 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ccc46df-c206-4de0-82bd-3679564d473a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:29.844385 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ccc46df-c206-4de0-82bd-3679564d473a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:29.856781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d5b7f781-2acf-4e99-8593-8734af54705c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:29.859625 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d5b7f781-2acf-4e99-8593-8734af54705c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:29.861747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d5b7f781-2acf-4e99-8593-8734af54705c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:29.862827 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d5b7f781-2acf-4e99-8593-8734af54705c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:29.865246 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d5b7f781-2acf-4e99-8593-8734af54705c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:29.873214 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d5b7f781-2acf-4e99-8593-8734af54705c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:30.080502 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5ccc46df-c206-4de0-82bd-3679564d473a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:30.100906 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5ccc46df-c206-4de0-82bd-3679564d473a tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1620 microversion: 2.1 time: 0.299114 Sep 27 16:42:30.103597 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 401/765] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:29 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1620 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:30.481357 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d5b7f781-2acf-4e99-8593-8734af54705c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:30.500018 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d5b7f781-2acf-4e99-8593-8734af54705c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:30.508880 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d5b7f781-2acf-4e99-8593-8734af54705c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:30.510156 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d5b7f781-2acf-4e99-8593-8734af54705c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1740 microversion: 2.20 time: 0.686839 Sep 27 16:42:30.510750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 365/766] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:29 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1740 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:30.945630 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-d3ea43a9-3a7e-4862-894a-5d9e45b81b2a req-a9e16de2-5195-4a53-805b-7d591922988f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c68417-b41c-4ab3-9fac-9e7087bfe731", "name": "network-vif-deleted", "tag": "3886c674-6e5a-4ef4-b25f-926b0453292c"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:42:30.967911 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-d3ea43a9-3a7e-4862-894a-5d9e45b81b2a req-a9e16de2-5195-4a53-805b-7d591922988f service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:30.968804 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-d3ea43a9-3a7e-4862-894a-5d9e45b81b2a req-a9e16de2-5195-4a53-805b-7d591922988f service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:30.969498 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-d3ea43a9-3a7e-4862-894a-5d9e45b81b2a req-a9e16de2-5195-4a53-805b-7d591922988f service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:30.999319 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-d3ea43a9-3a7e-4862-894a-5d9e45b81b2a req-a9e16de2-5195-4a53-805b-7d591922988f service nova] Creating event network-vif-deleted:3886c674-6e5a-4ef4-b25f-926b0453292c for instance 18c68417-b41c-4ab3-9fac-9e7087bfe731 on hv-cinder-85506 Sep 27 16:42:31.009100 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-d3ea43a9-3a7e-4862-894a-5d9e45b81b2a req-a9e16de2-5195-4a53-805b-7d591922988f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074872 Sep 27 16:42:31.018833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 402/767] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:42:31.129723 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2e18ce7e-47ee-4f97-baae-3989220d52d3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:31.131030 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2e18ce7e-47ee-4f97-baae-3989220d52d3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:31.154359 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e18ce7e-47ee-4f97-baae-3989220d52d3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:31.164775 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e18ce7e-47ee-4f97-baae-3989220d52d3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:31.165508 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e18ce7e-47ee-4f97-baae-3989220d52d3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:31.166485 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e18ce7e-47ee-4f97-baae-3989220d52d3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:31.167977 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e18ce7e-47ee-4f97-baae-3989220d52d3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:31.169493 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e18ce7e-47ee-4f97-baae-3989220d52d3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:31.298519 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2e18ce7e-47ee-4f97-baae-3989220d52d3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:31.319946 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2e18ce7e-47ee-4f97-baae-3989220d52d3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1330 microversion: 2.1 time: 0.195635 Sep 27 16:42:31.323202 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 366/768] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:31 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1330 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:31.544335 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a9d19671-ece9-414b-8ba6-39137ad912e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:31.545322 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a9d19671-ece9-414b-8ba6-39137ad912e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:31.558011 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9d19671-ece9-414b-8ba6-39137ad912e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:31.559487 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9d19671-ece9-414b-8ba6-39137ad912e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:31.561847 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9d19671-ece9-414b-8ba6-39137ad912e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:31.562744 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9d19671-ece9-414b-8ba6-39137ad912e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:31.564437 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9d19671-ece9-414b-8ba6-39137ad912e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:31.565035 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9d19671-ece9-414b-8ba6-39137ad912e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:31.925066 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a9d19671-ece9-414b-8ba6-39137ad912e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:31.925066 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a9d19671-ece9-414b-8ba6-39137ad912e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:31.926558 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a9d19671-ece9-414b-8ba6-39137ad912e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:31.926558 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a9d19671-ece9-414b-8ba6-39137ad912e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1740 microversion: 2.20 time: 0.290195 Sep 27 16:42:31.926558 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 403/769] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:31 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1740 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:32.349174 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ec68e6a1-2e98-4b58-97c9-4b181a7bb95f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:32.350321 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ec68e6a1-2e98-4b58-97c9-4b181a7bb95f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:32.358310 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ec68e6a1-2e98-4b58-97c9-4b181a7bb95f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:32.358834 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ec68e6a1-2e98-4b58-97c9-4b181a7bb95f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:32.359397 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ec68e6a1-2e98-4b58-97c9-4b181a7bb95f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:32.360135 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ec68e6a1-2e98-4b58-97c9-4b181a7bb95f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:32.360763 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ec68e6a1-2e98-4b58-97c9-4b181a7bb95f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:32.361390 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ec68e6a1-2e98-4b58-97c9-4b181a7bb95f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:32.450954 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ec68e6a1-2e98-4b58-97c9-4b181a7bb95f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:32.451605 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ec68e6a1-2e98-4b58-97c9-4b181a7bb95f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:32.452102 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ec68e6a1-2e98-4b58-97c9-4b181a7bb95f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:32.452617 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-ec68e6a1-2e98-4b58-97c9-4b181a7bb95f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lazy-loading 'fault' on Instance uuid 18c68417-b41c-4ab3-9fac-9e7087bfe731 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:42:32.522238 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ec68e6a1-2e98-4b58-97c9-4b181a7bb95f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:32.531285 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ec68e6a1-2e98-4b58-97c9-4b181a7bb95f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 200 len: 1335 microversion: 2.1 time: 0.188370 Sep 27 16:42:32.535043 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 367/770] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:32 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 1335 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:32.948935 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-684d2a38-9614-45be-8107-055abbac628d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:32.950226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-684d2a38-9614-45be-8107-055abbac628d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:32.957508 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-684d2a38-9614-45be-8107-055abbac628d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:32.958333 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-684d2a38-9614-45be-8107-055abbac628d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:32.958897 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-684d2a38-9614-45be-8107-055abbac628d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:32.959714 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-684d2a38-9614-45be-8107-055abbac628d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:32.960383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-684d2a38-9614-45be-8107-055abbac628d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:32.961032 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-684d2a38-9614-45be-8107-055abbac628d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:33.133850 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-684d2a38-9614-45be-8107-055abbac628d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:33.142624 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-684d2a38-9614-45be-8107-055abbac628d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:33.145766 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-684d2a38-9614-45be-8107-055abbac628d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:33.147106 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-684d2a38-9614-45be-8107-055abbac628d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1740 microversion: 2.20 time: 0.202743 Sep 27 16:42:33.148206 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 404/771] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:32 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:33.557377 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ceb34096-aa8a-4529-a144-da8a724685b3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:33.557963 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ceb34096-aa8a-4529-a144-da8a724685b3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 18c68417-b41c-4ab3-9fac-9e7087bfe731] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:33.568554 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ceb34096-aa8a-4529-a144-da8a724685b3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:33.571263 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ceb34096-aa8a-4529-a144-da8a724685b3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:33.571263 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ceb34096-aa8a-4529-a144-da8a724685b3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:33.571263 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ceb34096-aa8a-4529-a144-da8a724685b3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:33.571263 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ceb34096-aa8a-4529-a144-da8a724685b3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:33.571977 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ceb34096-aa8a-4529-a144-da8a724685b3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:33.587517 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-ceb34096-aa8a-4529-a144-da8a724685b3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] HTTP exception thrown: Instance 18c68417-b41c-4ab3-9fac-9e7087bfe731 could not be found. Sep 27 16:42:33.589199 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ceb34096-aa8a-4529-a144-da8a724685b3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Request method failure captured: Sep 27 16:42:33.589199 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 HTTP/1.1 Sep 27 16:42:33.589199 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:42:33.589199 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:42:33.589199 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:42:33.589199 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 27 16:42:33.589199 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:42:33.589199 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:42:33.589199 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:42:33.589199 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:42:33.589199 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMybbp91lepYQw85tUquWCV9UR5RezmQYrVfqE15tUFFE5y2X68s4nmn2P-J26dEvIkXNr6K7LpWu32utpxO1WVZFPVbAUVkBy8ED55Dss_89HF5N9IwPzLh5PE1Lkzf5zU-RvYh05UuJNz1vky_4nFLpZn78rK0k61y3SURPRT-cpXI Sep 27 16:42:33.589199 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:42:33.589199 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:42:33.589199 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:42:33.589199 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:42:33.589199 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:42:33.589199 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:42:33.589199 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: 9288b4e62bc945479636aec307a98746 Sep 27 16:42:33.589199 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-54837262 Sep 27 16:42:33.589199 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:42:33.589199 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:42:33.590586 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9288b4e62bc945479636aec307a98746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9288b4e62bc945479636aec307a98746"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9288b4e62bc945479636aec307a98746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9288b4e62bc945479636aec307a98746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:42:33.590586 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-ServerRescueNegativeTestJSON-54837262 Sep 27 16:42:33.590586 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 9288b4e62bc945479636aec307a98746 Sep 27 16:42:33.590586 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-54837262 Sep 27 16:42:33.590586 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-ServerRescueNegativeTestJSON-54837262-project Sep 27 16:42:33.590586 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:42:33.590586 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:42:33.590586 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: 2f9e55a3ff7c424dbd7a58f0eb92b8ce Sep 27 16:42:33.590586 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-ServerRescueNegativeTestJSON-54837262-project Sep 27 16:42:33.590586 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: > Sep 27 16:42:33.590586 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Instance 18c68417-b41c-4ab3-9fac-9e7087bfe731 could not be found. Sep 27 16:42:33.590586 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'id': '18c68417-b41c-4ab3-9fac-9e7087bfe731'} Sep 27 16:42:33.591430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:42:33.591430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:42:33.591430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:42:33.591430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:42:33.591430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:42:33.591430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:42:33.591430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:42:33.591430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:42:33.591430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:42:33.591430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:42:33.591430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18c68417-b41c-4ab3-9fac-9e7087bfe731 could not be found. Sep 27 16:42:33.591430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:42:33.591430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:42:33.591430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:42:33.591430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:42:33.591430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:42:33.591430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:42:33.591430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:42:33.591430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:42:33.591430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:42:33.592730 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:42:33.592730 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:42:33.592730 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:42:33.592730 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:42:33.592730 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:42:33.592730 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:42:33.592730 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:42:33.592730 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18c68417-b41c-4ab3-9fac-9e7087bfe731 could not be found. Sep 27 16:42:33.592730 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:42:33.592730 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:42:33.592730 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:42:33.592730 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:42:33.592730 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:42:33.592730 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:42:33.592730 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:42:33.592730 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:42:33.592730 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18c68417-b41c-4ab3-9fac-9e7087bfe731 could not be found. Sep 27 16:42:33.592730 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:42:33.593862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ceb34096-aa8a-4529-a144-da8a724685b3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Returning 404 to user: Instance 18c68417-b41c-4ab3-9fac-9e7087bfe731 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:42:33.593862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ceb34096-aa8a-4529-a144-da8a724685b3 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731" status: 404 len: 111 microversion: 2.1 time: 0.037601 Sep 27 16:42:33.600032 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4e2c8ee4-cafc-44c3-958b-4fc6899115cf tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '.version_select at 0x7fa405a56af0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:33.606032 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 368/772] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:33 2022] GET /compute/v2.1/servers/18c68417-b41c-4ab3-9fac-9e7087bfe731 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:42:33.715021 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4e2c8ee4-cafc-44c3-958b-4fc6899115cf tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-205589464" status: 202 len: 0 microversion: 2.1 time: 0.118842 Sep 27 16:42:33.720224 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 405/773] 10.222.0.64 () {58 vars in 1218 bytes} [Tue Sep 27 16:42:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-205589464 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:42:34.173655 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6b7e8449-2296-4a12-8534-a72ff462dded tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:34.174382 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6b7e8449-2296-4a12-8534-a72ff462dded tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:34.183859 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6b7e8449-2296-4a12-8534-a72ff462dded tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:34.184360 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6b7e8449-2296-4a12-8534-a72ff462dded tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:34.188424 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6b7e8449-2296-4a12-8534-a72ff462dded tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:34.188424 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6b7e8449-2296-4a12-8534-a72ff462dded tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:34.188829 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6b7e8449-2296-4a12-8534-a72ff462dded tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:34.189265 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6b7e8449-2296-4a12-8534-a72ff462dded tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:34.446059 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b3542aa2-0591-4dec-9580-6aa7a57d7db0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:34.447601 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b3542aa2-0591-4dec-9580-6aa7a57d7db0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:34.458116 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b3542aa2-0591-4dec-9580-6aa7a57d7db0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:34.459027 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b3542aa2-0591-4dec-9580-6aa7a57d7db0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:34.460667 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b3542aa2-0591-4dec-9580-6aa7a57d7db0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:34.461605 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b3542aa2-0591-4dec-9580-6aa7a57d7db0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:34.462495 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b3542aa2-0591-4dec-9580-6aa7a57d7db0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:34.463167 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b3542aa2-0591-4dec-9580-6aa7a57d7db0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:34.498649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b3542aa2-0591-4dec-9580-6aa7a57d7db0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 16:42:34.515606 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6b7e8449-2296-4a12-8534-a72ff462dded tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:34.533248 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6b7e8449-2296-4a12-8534-a72ff462dded tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:34.534705 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6b7e8449-2296-4a12-8534-a72ff462dded tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:34.538799 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6b7e8449-2296-4a12-8534-a72ff462dded tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1740 microversion: 2.20 time: 0.369256 Sep 27 16:42:34.539374 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 369/774] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:34 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1740 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:34.886345 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b3542aa2-0591-4dec-9580-6aa7a57d7db0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 204 len: 0 microversion: 2.1 time: 0.445610 Sep 27 16:42:34.887153 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 406/775] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:42:34 2022] DELETE /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 16:42:34.898386 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-115b5f43-1c8d-46bb-a1b2-9c373fe21d72 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:34.899724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-115b5f43-1c8d-46bb-a1b2-9c373fe21d72 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:34.919282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-115b5f43-1c8d-46bb-a1b2-9c373fe21d72 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:34.920603 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-115b5f43-1c8d-46bb-a1b2-9c373fe21d72 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:34.921210 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-115b5f43-1c8d-46bb-a1b2-9c373fe21d72 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:34.923035 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-115b5f43-1c8d-46bb-a1b2-9c373fe21d72 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:34.923664 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-115b5f43-1c8d-46bb-a1b2-9c373fe21d72 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:34.924816 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-115b5f43-1c8d-46bb-a1b2-9c373fe21d72 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:35.198046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-115b5f43-1c8d-46bb-a1b2-9c373fe21d72 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:35.214502 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-115b5f43-1c8d-46bb-a1b2-9c373fe21d72 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1576 microversion: 2.1 time: 0.320247 Sep 27 16:42:35.216803 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 370/776] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:34 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1576 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:35.569706 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e9f8c07e-6076-4240-9eb3-d941f670392d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:35.570416 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e9f8c07e-6076-4240-9eb3-d941f670392d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:35.576890 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9f8c07e-6076-4240-9eb3-d941f670392d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:35.577590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9f8c07e-6076-4240-9eb3-d941f670392d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:35.578225 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9f8c07e-6076-4240-9eb3-d941f670392d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:35.579331 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9f8c07e-6076-4240-9eb3-d941f670392d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:35.579952 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9f8c07e-6076-4240-9eb3-d941f670392d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:35.580536 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9f8c07e-6076-4240-9eb3-d941f670392d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:35.830119 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e9f8c07e-6076-4240-9eb3-d941f670392d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:35.842633 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e9f8c07e-6076-4240-9eb3-d941f670392d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:35.849753 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e9f8c07e-6076-4240-9eb3-d941f670392d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:35.851425 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e9f8c07e-6076-4240-9eb3-d941f670392d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1740 microversion: 2.20 time: 0.287398 Sep 27 16:42:35.856436 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 407/777] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:35 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1740 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:36.244532 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7be0ce96-118d-48e0-9ba2-d2fae5b7b1d3 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:36.246177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7be0ce96-118d-48e0-9ba2-d2fae5b7b1d3 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:36.254127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7be0ce96-118d-48e0-9ba2-d2fae5b7b1d3 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:36.255029 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7be0ce96-118d-48e0-9ba2-d2fae5b7b1d3 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:36.255686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7be0ce96-118d-48e0-9ba2-d2fae5b7b1d3 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:36.256650 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7be0ce96-118d-48e0-9ba2-d2fae5b7b1d3 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:36.257363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7be0ce96-118d-48e0-9ba2-d2fae5b7b1d3 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:36.258136 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7be0ce96-118d-48e0-9ba2-d2fae5b7b1d3 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:36.545101 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7be0ce96-118d-48e0-9ba2-d2fae5b7b1d3 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:36.562627 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7be0ce96-118d-48e0-9ba2-d2fae5b7b1d3 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1576 microversion: 2.1 time: 0.318555 Sep 27 16:42:36.563349 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 371/778] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:36 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1576 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:36.883315 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-85ac2486-9ecb-47b0-9728-a99d7bd8a913 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:36.884671 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-85ac2486-9ecb-47b0-9728-a99d7bd8a913 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:36.892155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85ac2486-9ecb-47b0-9728-a99d7bd8a913 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:36.893172 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85ac2486-9ecb-47b0-9728-a99d7bd8a913 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:36.893823 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85ac2486-9ecb-47b0-9728-a99d7bd8a913 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:36.894994 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85ac2486-9ecb-47b0-9728-a99d7bd8a913 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:36.895709 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85ac2486-9ecb-47b0-9728-a99d7bd8a913 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:36.896489 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85ac2486-9ecb-47b0-9728-a99d7bd8a913 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:37.149349 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-85ac2486-9ecb-47b0-9728-a99d7bd8a913 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:37.158249 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-85ac2486-9ecb-47b0-9728-a99d7bd8a913 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:37.160511 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-85ac2486-9ecb-47b0-9728-a99d7bd8a913 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:37.162146 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-85ac2486-9ecb-47b0-9728-a99d7bd8a913 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1740 microversion: 2.20 time: 0.283368 Sep 27 16:42:37.181527 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 408/779] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:36 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1740 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:37.587271 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-02d88c9a-184a-487b-a732-cf18443f8a22 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:37.587899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-02d88c9a-184a-487b-a732-cf18443f8a22 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:37.594184 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-02d88c9a-184a-487b-a732-cf18443f8a22 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:37.594674 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-02d88c9a-184a-487b-a732-cf18443f8a22 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:37.595143 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-02d88c9a-184a-487b-a732-cf18443f8a22 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:37.595836 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-02d88c9a-184a-487b-a732-cf18443f8a22 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:37.596297 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-02d88c9a-184a-487b-a732-cf18443f8a22 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:37.596718 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-02d88c9a-184a-487b-a732-cf18443f8a22 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:37.865101 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-02d88c9a-184a-487b-a732-cf18443f8a22 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:37.892468 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-02d88c9a-184a-487b-a732-cf18443f8a22 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1576 microversion: 2.1 time: 0.308880 Sep 27 16:42:37.915331 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 372/780] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:37 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1576 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:38.072280 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3f73c257-5bdf-49b4-af5b-53f22cbaba7e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:38.073456 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3f73c257-5bdf-49b4-af5b-53f22cbaba7e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:38.080597 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f73c257-5bdf-49b4-af5b-53f22cbaba7e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:38.081307 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f73c257-5bdf-49b4-af5b-53f22cbaba7e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:38.082474 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f73c257-5bdf-49b4-af5b-53f22cbaba7e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:38.083504 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f73c257-5bdf-49b4-af5b-53f22cbaba7e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:38.084154 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f73c257-5bdf-49b4-af5b-53f22cbaba7e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:38.084771 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f73c257-5bdf-49b4-af5b-53f22cbaba7e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:38.118016 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3f73c257-5bdf-49b4-af5b-53f22cbaba7e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 16:42:38.189279 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-03611957-caaa-477c-aacc-c1688cd7c760 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:38.190360 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-03611957-caaa-477c-aacc-c1688cd7c760 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:38.204245 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03611957-caaa-477c-aacc-c1688cd7c760 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:38.211651 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03611957-caaa-477c-aacc-c1688cd7c760 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:38.212148 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03611957-caaa-477c-aacc-c1688cd7c760 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:38.212911 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03611957-caaa-477c-aacc-c1688cd7c760 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:38.213371 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03611957-caaa-477c-aacc-c1688cd7c760 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:38.213801 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03611957-caaa-477c-aacc-c1688cd7c760 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:38.239976 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:38.464697 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3f73c257-5bdf-49b4-af5b-53f22cbaba7e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "DELETE /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 204 len: 0 microversion: 2.1 time: 0.394297 Sep 27 16:42:38.476146 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 409/781] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:42:38 2022] DELETE /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 16:42:38.476146 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2a39e439-08f4-4906-9eb0-75843741347e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:38.477892 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2a39e439-08f4-4906-9eb0-75843741347e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:38.492906 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2a39e439-08f4-4906-9eb0-75843741347e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:38.496652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2a39e439-08f4-4906-9eb0-75843741347e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:38.497314 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2a39e439-08f4-4906-9eb0-75843741347e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:38.500706 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2a39e439-08f4-4906-9eb0-75843741347e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:38.502130 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2a39e439-08f4-4906-9eb0-75843741347e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:38.506102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2a39e439-08f4-4906-9eb0-75843741347e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:38.703878 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-03611957-caaa-477c-aacc-c1688cd7c760 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:38.724867 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-03611957-caaa-477c-aacc-c1688cd7c760 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:38.727317 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-03611957-caaa-477c-aacc-c1688cd7c760 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:38.728654 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-03611957-caaa-477c-aacc-c1688cd7c760 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1740 microversion: 2.20 time: 0.543256 Sep 27 16:42:38.732123 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 373/782] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:38 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1740 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:38.866435 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2a39e439-08f4-4906-9eb0-75843741347e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:38.887883 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2a39e439-08f4-4906-9eb0-75843741347e tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1508 microversion: 2.1 time: 0.417724 Sep 27 16:42:38.893255 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 410/783] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:38 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1508 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:42:38.929385 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a893d78f-1f08-465a-89b3-cd6dfb202fd6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:38.930248 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a893d78f-1f08-465a-89b3-cd6dfb202fd6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:38.947049 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a893d78f-1f08-465a-89b3-cd6dfb202fd6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:38.948147 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a893d78f-1f08-465a-89b3-cd6dfb202fd6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:38.949092 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a893d78f-1f08-465a-89b3-cd6dfb202fd6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:38.953652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-a6b744a5-e853-45c2-9039-5aa7360ce785 req-d88c57be-3cd5-47b3-8b19-8950518a620a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d959d05-2c44-4e4c-a8c0-9dd0b985b564", "name": "network-vif-deleted", "tag": "52f691b3-ea75-4afe-9e42-e90c76a84965"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:42:38.955087 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a893d78f-1f08-465a-89b3-cd6dfb202fd6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:38.956024 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a893d78f-1f08-465a-89b3-cd6dfb202fd6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:38.956749 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a893d78f-1f08-465a-89b3-cd6dfb202fd6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:38.966515 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-a6b744a5-e853-45c2-9039-5aa7360ce785 req-d88c57be-3cd5-47b3-8b19-8950518a620a service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:38.967037 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-a6b744a5-e853-45c2-9039-5aa7360ce785 req-d88c57be-3cd5-47b3-8b19-8950518a620a service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:38.967652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-a6b744a5-e853-45c2-9039-5aa7360ce785 req-d88c57be-3cd5-47b3-8b19-8950518a620a service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:38.980401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-a6b744a5-e853-45c2-9039-5aa7360ce785 req-d88c57be-3cd5-47b3-8b19-8950518a620a service nova] Creating event network-vif-deleted:52f691b3-ea75-4afe-9e42-e90c76a84965 for instance 3d959d05-2c44-4e4c-a8c0-9dd0b985b564 on hv-cinder-85506 Sep 27 16:42:38.986177 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-a6b744a5-e853-45c2-9039-5aa7360ce785 req-d88c57be-3cd5-47b3-8b19-8950518a620a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036998 Sep 27 16:42:38.991669 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 411/784] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:42:39.085705 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a893d78f-1f08-465a-89b3-cd6dfb202fd6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:39.103826 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a893d78f-1f08-465a-89b3-cd6dfb202fd6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1509 microversion: 2.1 time: 0.180435 Sep 27 16:42:39.119810 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 374/785] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:38 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1509 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:39.759679 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fab161bc-dcdb-49bd-9b83-ea2e0ae7c71c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:39.760619 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fab161bc-dcdb-49bd-9b83-ea2e0ae7c71c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:39.779288 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fab161bc-dcdb-49bd-9b83-ea2e0ae7c71c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:39.780011 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fab161bc-dcdb-49bd-9b83-ea2e0ae7c71c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:39.780854 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fab161bc-dcdb-49bd-9b83-ea2e0ae7c71c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:39.781749 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fab161bc-dcdb-49bd-9b83-ea2e0ae7c71c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:39.782439 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fab161bc-dcdb-49bd-9b83-ea2e0ae7c71c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:39.783106 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fab161bc-dcdb-49bd-9b83-ea2e0ae7c71c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:39.920017 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e0269c65-4718-4d4b-b2f1-55f0269a09e8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:39.921493 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e0269c65-4718-4d4b-b2f1-55f0269a09e8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:39.934322 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0269c65-4718-4d4b-b2f1-55f0269a09e8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:39.937195 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0269c65-4718-4d4b-b2f1-55f0269a09e8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:39.939006 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0269c65-4718-4d4b-b2f1-55f0269a09e8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:39.949303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0269c65-4718-4d4b-b2f1-55f0269a09e8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:39.949303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0269c65-4718-4d4b-b2f1-55f0269a09e8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:39.949303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0269c65-4718-4d4b-b2f1-55f0269a09e8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:40.004613 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fab161bc-dcdb-49bd-9b83-ea2e0ae7c71c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:40.014542 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fab161bc-dcdb-49bd-9b83-ea2e0ae7c71c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:40.017022 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fab161bc-dcdb-49bd-9b83-ea2e0ae7c71c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:40.018379 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fab161bc-dcdb-49bd-9b83-ea2e0ae7c71c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1740 microversion: 2.20 time: 0.264442 Sep 27 16:42:40.019950 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 412/786] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:39 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1740 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:40.107924 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e0269c65-4718-4d4b-b2f1-55f0269a09e8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:40.117811 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e0269c65-4718-4d4b-b2f1-55f0269a09e8 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1508 microversion: 2.1 time: 0.202430 Sep 27 16:42:40.118564 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 375/787] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:39 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1508 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:40.134607 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-920da60c-7c90-46f1-9bb4-9a149d0a026e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:40.135287 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-920da60c-7c90-46f1-9bb4-9a149d0a026e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:40.141961 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-920da60c-7c90-46f1-9bb4-9a149d0a026e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:40.142467 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-920da60c-7c90-46f1-9bb4-9a149d0a026e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:40.142948 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-920da60c-7c90-46f1-9bb4-9a149d0a026e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:40.144659 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-920da60c-7c90-46f1-9bb4-9a149d0a026e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:40.144659 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-920da60c-7c90-46f1-9bb4-9a149d0a026e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:40.145066 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-920da60c-7c90-46f1-9bb4-9a149d0a026e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:40.328823 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-920da60c-7c90-46f1-9bb4-9a149d0a026e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:40.346535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-920da60c-7c90-46f1-9bb4-9a149d0a026e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1509 microversion: 2.1 time: 0.216018 Sep 27 16:42:40.348315 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 413/788] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:40 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:42:41.045951 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-380ac64f-8777-4aa6-b2cf-68a07ea3816f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:41.047010 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-380ac64f-8777-4aa6-b2cf-68a07ea3816f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:41.054522 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-380ac64f-8777-4aa6-b2cf-68a07ea3816f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:41.055152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-380ac64f-8777-4aa6-b2cf-68a07ea3816f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:41.055712 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-380ac64f-8777-4aa6-b2cf-68a07ea3816f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:41.056478 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-380ac64f-8777-4aa6-b2cf-68a07ea3816f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:41.057131 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-380ac64f-8777-4aa6-b2cf-68a07ea3816f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:41.057899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-380ac64f-8777-4aa6-b2cf-68a07ea3816f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:41.141629 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7472f10d-63d4-4a79-98cf-f7c4e6e8ac1d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:41.142439 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7472f10d-63d4-4a79-98cf-f7c4e6e8ac1d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:41.148776 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7472f10d-63d4-4a79-98cf-f7c4e6e8ac1d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:41.149485 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7472f10d-63d4-4a79-98cf-f7c4e6e8ac1d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:41.149919 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7472f10d-63d4-4a79-98cf-f7c4e6e8ac1d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:41.150799 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7472f10d-63d4-4a79-98cf-f7c4e6e8ac1d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:41.151436 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7472f10d-63d4-4a79-98cf-f7c4e6e8ac1d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:41.151845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7472f10d-63d4-4a79-98cf-f7c4e6e8ac1d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:41.171729 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:41.360372 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-380ac64f-8777-4aa6-b2cf-68a07ea3816f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:41.377603 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-380ac64f-8777-4aa6-b2cf-68a07ea3816f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:41.380556 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-380ac64f-8777-4aa6-b2cf-68a07ea3816f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:41.386106 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-380ac64f-8777-4aa6-b2cf-68a07ea3816f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1740 microversion: 2.20 time: 0.344543 Sep 27 16:42:41.404132 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 376/789] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:41 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1740 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:41.412439 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-42a37d4c-ea84-4841-aaea-a9750846cadf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:41.413424 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-42a37d4c-ea84-4841-aaea-a9750846cadf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:41.428522 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42a37d4c-ea84-4841-aaea-a9750846cadf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:41.428522 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42a37d4c-ea84-4841-aaea-a9750846cadf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:41.428522 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42a37d4c-ea84-4841-aaea-a9750846cadf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:41.428522 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42a37d4c-ea84-4841-aaea-a9750846cadf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:41.428889 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42a37d4c-ea84-4841-aaea-a9750846cadf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:41.428889 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42a37d4c-ea84-4841-aaea-a9750846cadf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:41.517329 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-42a37d4c-ea84-4841-aaea-a9750846cadf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:41.519988 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7472f10d-63d4-4a79-98cf-f7c4e6e8ac1d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:41.529387 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-42a37d4c-ea84-4841-aaea-a9750846cadf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 200 len: 1225 microversion: 2.1 time: 0.123901 Sep 27 16:42:41.529830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 377/790] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:41 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 1225 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:41.531397 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7472f10d-63d4-4a79-98cf-f7c4e6e8ac1d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1508 microversion: 2.1 time: 0.393674 Sep 27 16:42:41.532138 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 414/791] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:41 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1508 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:42:42.012610 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7b029d17-04ab-4cb8-83d8-c30b1c7df810 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Action: 'create', calling method: .version_select at 0x7fa405748a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1242109760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYaei1zhqwm4YmDVQWyIo/ChZUttcnyRk4dl5ONGo4LYJm/hR0825s8fK2aS0kW/mOmCoKvTBFhOR+Q6lH9c9lBQgd0t/8B8mBpC+BwaVpQfIXOEFmrzbnGbngUzOS7jQ=="}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:42:42.030708 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-7b029d17-04ab-4cb8-83d8-c30b1c7df810 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Getting quotas for project eb77c9fe25cb4abda83cb3d2e665557a. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:42:42.034979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-7b029d17-04ab-4cb8-83d8-c30b1c7df810 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Getting quotas for user af5c944405e8435f9e0eccaaee764cd2 and project eb77c9fe25cb4abda83cb3d2e665557a. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:42:42.142184 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7b029d17-04ab-4cb8-83d8-c30b1c7df810 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.311109 Sep 27 16:42:42.143835 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 378/792] 10.222.0.64 () {60 vars in 1159 bytes} [Tue Sep 27 16:42:41 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:42:42.221994 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-7badfc7d-9607-4855-a68b-934c049cd20b req-eef74039-13ec-4005-81a3-60600698b68b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666", "name": "network-vif-deleted", "tag": "207d0a14-eef1-4291-ac34-12fd2700d04d"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:42:42.232125 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-7badfc7d-9607-4855-a68b-934c049cd20b req-eef74039-13ec-4005-81a3-60600698b68b service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:42.232735 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-7badfc7d-9607-4855-a68b-934c049cd20b req-eef74039-13ec-4005-81a3-60600698b68b service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:42.233420 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-7badfc7d-9607-4855-a68b-934c049cd20b req-eef74039-13ec-4005-81a3-60600698b68b service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:42.246374 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-7badfc7d-9607-4855-a68b-934c049cd20b req-eef74039-13ec-4005-81a3-60600698b68b service nova] Creating event network-vif-deleted:207d0a14-eef1-4291-ac34-12fd2700d04d for instance 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 on hv-cinder-85506 Sep 27 16:42:42.257617 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-7badfc7d-9607-4855-a68b-934c049cd20b req-eef74039-13ec-4005-81a3-60600698b68b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038954 Sep 27 16:42:42.259759 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 415/793] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:42:42.419682 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-55108515-2fae-4077-b407-e3dc2448dd1f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:42.422015 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-55108515-2fae-4077-b407-e3dc2448dd1f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:42.440637 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-55108515-2fae-4077-b407-e3dc2448dd1f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:42.442222 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-55108515-2fae-4077-b407-e3dc2448dd1f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:42.442897 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-55108515-2fae-4077-b407-e3dc2448dd1f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:42.443622 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-55108515-2fae-4077-b407-e3dc2448dd1f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:42.444262 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-55108515-2fae-4077-b407-e3dc2448dd1f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:42.444862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-55108515-2fae-4077-b407-e3dc2448dd1f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:42.558162 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-90466c32-6b81-4169-906f-74daea819e43 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:42.558917 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-90466c32-6b81-4169-906f-74daea819e43 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:42.567590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90466c32-6b81-4169-906f-74daea819e43 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:42.568522 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90466c32-6b81-4169-906f-74daea819e43 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:42.569288 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90466c32-6b81-4169-906f-74daea819e43 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:42.570215 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90466c32-6b81-4169-906f-74daea819e43 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:42.570943 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90466c32-6b81-4169-906f-74daea819e43 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:42.571705 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90466c32-6b81-4169-906f-74daea819e43 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:42.593437 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-90466c32-6b81-4169-906f-74daea819e43 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] HTTP exception thrown: Instance 3d959d05-2c44-4e4c-a8c0-9dd0b985b564 could not be found. Sep 27 16:42:42.595405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-90466c32-6b81-4169-906f-74daea819e43 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Request method failure captured: Sep 27 16:42:42.595405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 HTTP/1.1 Sep 27 16:42:42.595405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:42:42.595405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:42:42.595405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:42:42.595405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:42:42.595405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:42:42.595405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:42:42.595405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:42:42.595405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:42:42.595405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMycmHtLFvrjDMir7PsAl0jrokT3pa5jWD2AqQrwOiXUSlp_VBcvOvskgl7hrGZA-R6N8tY93GKubrDEbGHZBxN-0A8f0iTnGL1Me323dLs24OolKvT3wb_agnoXINlz6fmbhBYmwIDMLWanClMBO1rnYG_y7132m0PKHDP3kJPGf9_I Sep 27 16:42:42.595405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:42:42.595405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:42:42.595405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:42:42.595405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:42:42.595405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:42:42.595405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:42:42.595405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 1e0f894b53284e788cdb4864acd917be Sep 27 16:42:42.595405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-TestVolumeBootPattern-410545175 Sep 27 16:42:42.595405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:42:42.595405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:42:42.596940 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e0f894b53284e788cdb4864acd917be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1e0f894b53284e788cdb4864acd917be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1e0f894b53284e788cdb4864acd917be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e0f894b53284e788cdb4864acd917be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:42:42.596940 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-TestVolumeBootPattern-410545175 Sep 27 16:42:42.596940 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 1e0f894b53284e788cdb4864acd917be Sep 27 16:42:42.596940 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-TestVolumeBootPattern-410545175 Sep 27 16:42:42.596940 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-TestVolumeBootPattern-410545175-project Sep 27 16:42:42.596940 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:42:42.596940 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:42:42.596940 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: 421aaa238a3c495096dfc55aba76267c Sep 27 16:42:42.596940 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-TestVolumeBootPattern-410545175-project Sep 27 16:42:42.596940 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:42:42.596940 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Instance 3d959d05-2c44-4e4c-a8c0-9dd0b985b564 could not be found. Sep 27 16:42:42.596940 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': '3d959d05-2c44-4e4c-a8c0-9dd0b985b564'} Sep 27 16:42:42.597844 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:42:42.597844 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:42:42.597844 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:42:42.597844 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:42:42.597844 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:42:42.597844 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:42:42.597844 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:42:42.597844 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:42:42.597844 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:42:42.597844 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:42:42.597844 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d959d05-2c44-4e4c-a8c0-9dd0b985b564 could not be found. Sep 27 16:42:42.597844 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:42:42.597844 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:42:42.597844 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:42:42.597844 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:42:42.597844 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:42:42.597844 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:42:42.597844 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:42:42.597844 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:42:42.597844 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:42:42.599195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:42:42.599195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:42:42.599195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:42:42.599195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:42:42.599195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:42:42.599195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:42:42.599195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:42:42.599195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d959d05-2c44-4e4c-a8c0-9dd0b985b564 could not be found. Sep 27 16:42:42.599195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:42:42.599195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:42:42.599195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:42:42.599195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:42:42.599195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:42:42.599195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:42:42.599195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:42:42.599195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:42:42.599195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d959d05-2c44-4e4c-a8c0-9dd0b985b564 could not be found. Sep 27 16:42:42.599195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:42:42.602010 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-90466c32-6b81-4169-906f-74daea819e43 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Returning 404 to user: Instance 3d959d05-2c44-4e4c-a8c0-9dd0b985b564 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:42:42.603078 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-90466c32-6b81-4169-906f-74daea819e43 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 404 len: 111 microversion: 2.1 time: 0.050076 Sep 27 16:42:42.604148 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 416/794] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:42 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 16:42:42.609025 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e4cee45e-d4c0-49f9-99fb-e8c1ffe9252f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:42.609830 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e4cee45e-d4c0-49f9-99fb-e8c1ffe9252f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:42.631816 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e4cee45e-d4c0-49f9-99fb-e8c1ffe9252f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:42.631953 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e4cee45e-d4c0-49f9-99fb-e8c1ffe9252f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:42.632381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e4cee45e-d4c0-49f9-99fb-e8c1ffe9252f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:42.633150 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e4cee45e-d4c0-49f9-99fb-e8c1ffe9252f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:42.633629 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e4cee45e-d4c0-49f9-99fb-e8c1ffe9252f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:42.634022 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e4cee45e-d4c0-49f9-99fb-e8c1ffe9252f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:42.667948 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e4cee45e-d4c0-49f9-99fb-e8c1ffe9252f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:42.668451 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e4cee45e-d4c0-49f9-99fb-e8c1ffe9252f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:42.668889 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e4cee45e-d4c0-49f9-99fb-e8c1ffe9252f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:42.669342 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-e4cee45e-d4c0-49f9-99fb-e8c1ffe9252f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lazy-loading 'fault' on Instance uuid 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:42:42.704819 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-55108515-2fae-4077-b407-e3dc2448dd1f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:42.714768 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-55108515-2fae-4077-b407-e3dc2448dd1f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:42.717528 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-55108515-2fae-4077-b407-e3dc2448dd1f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:42.723411 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-55108515-2fae-4077-b407-e3dc2448dd1f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1722 microversion: 2.20 time: 0.304905 Sep 27 16:42:42.723411 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 379/795] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:42 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1722 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:42.726960 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-79497cc6-4d10-4b6d-9e30-d5483de68276 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1505675774", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-878616145", "security_groups": [{"name": "tempest-secgroup-smoke-849232985"}], "block_device_mapping_v2": [{"uuid": "0761b009-de31-41b7-aca6-0b6c42514ac7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fa6ed79c-29cf-4084-8c9a-3f99a2a02140"}]}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:42:42.739906 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e4cee45e-d4c0-49f9-99fb-e8c1ffe9252f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:42.748986 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e4cee45e-d4c0-49f9-99fb-e8c1ffe9252f tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1311 microversion: 2.1 time: 0.143524 Sep 27 16:42:42.749854 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 417/796] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:42 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1311 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:42.885108 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-79497cc6-4d10-4b6d-9e30-d5483de68276 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] validate_networks() for [('fa6ed79c-29cf-4084-8c9a-3f99a2a02140', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 16:42:43.351341 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-79497cc6-4d10-4b6d-9e30-d5483de68276 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 16:42:43.351921 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-79497cc6-4d10-4b6d-9e30-d5483de68276 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 16:42:43.352295 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-79497cc6-4d10-4b6d-9e30-d5483de68276 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 16:42:43.352703 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-79497cc6-4d10-4b6d-9e30-d5483de68276 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 16:42:43.353121 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-79497cc6-4d10-4b6d-9e30-d5483de68276 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 16:42:43.362100 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79497cc6-4d10-4b6d-9e30-d5483de68276 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:43.363120 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79497cc6-4d10-4b6d-9e30-d5483de68276 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:43.363561 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79497cc6-4d10-4b6d-9e30-d5483de68276 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:43.364297 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79497cc6-4d10-4b6d-9e30-d5483de68276 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:43.364749 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79497cc6-4d10-4b6d-9e30-d5483de68276 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:43.365172 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79497cc6-4d10-4b6d-9e30-d5483de68276 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:43.382361 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-79497cc6-4d10-4b6d-9e30-d5483de68276 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Getting quotas for project 1e0f894b53284e788cdb4864acd917be. Resources: {'instances', 'ram', 'cores'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:42:43.386328 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-79497cc6-4d10-4b6d-9e30-d5483de68276 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Getting quotas for user 421aaa238a3c495096dfc55aba76267c and project 1e0f894b53284e788cdb4864acd917be. Resources: {'instances', 'ram', 'cores'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:42:43.451157 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-79497cc6-4d10-4b6d-9e30-d5483de68276 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 16:42:43.453366 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-79497cc6-4d10-4b6d-9e30-d5483de68276 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0761b009-de31-41b7-aca6-0b6c42514ac7',volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 16:42:43.749826 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-91a5c311-1c4d-4ff7-bc6c-2a02ea5d705f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:43.751041 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-91a5c311-1c4d-4ff7-bc6c-2a02ea5d705f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:43.758079 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91a5c311-1c4d-4ff7-bc6c-2a02ea5d705f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:43.758850 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91a5c311-1c4d-4ff7-bc6c-2a02ea5d705f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:43.759745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91a5c311-1c4d-4ff7-bc6c-2a02ea5d705f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:43.760512 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91a5c311-1c4d-4ff7-bc6c-2a02ea5d705f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:43.761171 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91a5c311-1c4d-4ff7-bc6c-2a02ea5d705f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:43.761681 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91a5c311-1c4d-4ff7-bc6c-2a02ea5d705f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:43.907955 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-91a5c311-1c4d-4ff7-bc6c-2a02ea5d705f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:43.917130 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-91a5c311-1c4d-4ff7-bc6c-2a02ea5d705f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:43.918658 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-91a5c311-1c4d-4ff7-bc6c-2a02ea5d705f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:43.923210 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-91a5c311-1c4d-4ff7-bc6c-2a02ea5d705f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1722 microversion: 2.20 time: 0.174106 Sep 27 16:42:43.923210 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 418/797] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:43 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:43.924876 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6c982e63-198f-4971-b574-461c4a899764 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:43.926726 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6c982e63-198f-4971-b574-461c4a899764 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:43.932736 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c982e63-198f-4971-b574-461c4a899764 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:43.933228 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c982e63-198f-4971-b574-461c4a899764 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:43.933666 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c982e63-198f-4971-b574-461c4a899764 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:43.934603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c982e63-198f-4971-b574-461c4a899764 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:43.935136 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c982e63-198f-4971-b574-461c4a899764 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:43.935567 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c982e63-198f-4971-b574-461c4a899764 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:43.971974 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c982e63-198f-4971-b574-461c4a899764 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:43.972785 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c982e63-198f-4971-b574-461c4a899764 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:43.973343 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c982e63-198f-4971-b574-461c4a899764 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:43.973987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-6c982e63-198f-4971-b574-461c4a899764 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lazy-loading 'fault' on Instance uuid 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:42:43.995555 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-79497cc6-4d10-4b6d-9e30-d5483de68276 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.266202 Sep 27 16:42:43.997377 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 380/798] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Sep 27 16:42:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 1276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 16:42:44.013428 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-881470ce-9b33-4507-a016-4a5c946fa25d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:44.014249 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-881470ce-9b33-4507-a016-4a5c946fa25d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:44.047694 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6c982e63-198f-4971-b574-461c4a899764 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:44.058053 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6c982e63-198f-4971-b574-461c4a899764 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1311 microversion: 2.1 time: 0.136566 Sep 27 16:42:44.059245 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 419/799] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:43 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1311 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:44.100138 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-881470ce-9b33-4507-a016-4a5c946fa25d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:44.109777 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-881470ce-9b33-4507-a016-4a5c946fa25d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1094 microversion: 2.1 time: 0.103585 Sep 27 16:42:44.110362 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 381/800] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:44 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1094 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:42:44.947079 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0d7d4a73-9049-4d7d-a0ba-63a874573e99 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:44.948107 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0d7d4a73-9049-4d7d-a0ba-63a874573e99 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:44.955021 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d7d4a73-9049-4d7d-a0ba-63a874573e99 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:44.955674 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d7d4a73-9049-4d7d-a0ba-63a874573e99 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:44.956217 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d7d4a73-9049-4d7d-a0ba-63a874573e99 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:44.957659 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d7d4a73-9049-4d7d-a0ba-63a874573e99 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:44.959015 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d7d4a73-9049-4d7d-a0ba-63a874573e99 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:44.959687 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d7d4a73-9049-4d7d-a0ba-63a874573e99 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:44.994747 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-7668dd14-d037-44c5-8ed0-dc0369801766 req-a933eeca-fa3f-40aa-b5d9-7357c46ad430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac", "name": "network-vif-unplugged", "status": "completed", "tag": "ddb6a707-22f0-4c10-adcc-9f4d5d262645"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:42:45.017486 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-7668dd14-d037-44c5-8ed0-dc0369801766 req-a933eeca-fa3f-40aa-b5d9-7357c46ad430 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:45.017995 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-7668dd14-d037-44c5-8ed0-dc0369801766 req-a933eeca-fa3f-40aa-b5d9-7357c46ad430 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:45.020041 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-7668dd14-d037-44c5-8ed0-dc0369801766 req-a933eeca-fa3f-40aa-b5d9-7357c46ad430 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:45.031897 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-7668dd14-d037-44c5-8ed0-dc0369801766 req-a933eeca-fa3f-40aa-b5d9-7357c46ad430 service nova] Creating event network-vif-unplugged:ddb6a707-22f0-4c10-adcc-9f4d5d262645 for instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac on hv-cinder-85506 Sep 27 16:42:45.037883 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-7668dd14-d037-44c5-8ed0-dc0369801766 req-a933eeca-fa3f-40aa-b5d9-7357c46ad430 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051272 Sep 27 16:42:45.038500 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 382/801] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:42:45.084612 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-66fe39f2-0a6d-4de4-ab17-4ad73fdc93fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:45.085580 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-66fe39f2-0a6d-4de4-ab17-4ad73fdc93fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:45.092897 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66fe39f2-0a6d-4de4-ab17-4ad73fdc93fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:45.093836 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66fe39f2-0a6d-4de4-ab17-4ad73fdc93fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:45.094432 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66fe39f2-0a6d-4de4-ab17-4ad73fdc93fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:45.095475 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66fe39f2-0a6d-4de4-ab17-4ad73fdc93fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:45.096092 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66fe39f2-0a6d-4de4-ab17-4ad73fdc93fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:45.098116 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66fe39f2-0a6d-4de4-ab17-4ad73fdc93fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:45.131152 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0d7d4a73-9049-4d7d-a0ba-63a874573e99 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:45.152080 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0d7d4a73-9049-4d7d-a0ba-63a874573e99 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:45.153830 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0d7d4a73-9049-4d7d-a0ba-63a874573e99 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:45.155491 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0d7d4a73-9049-4d7d-a0ba-63a874573e99 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1725 microversion: 2.20 time: 0.212148 Sep 27 16:42:45.156531 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 420/802] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:44 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:45.161999 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c95f655b-62c0-4de9-94ec-8313c7ad658d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:45.165935 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c95f655b-62c0-4de9-94ec-8313c7ad658d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:45.173524 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c95f655b-62c0-4de9-94ec-8313c7ad658d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:45.174324 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c95f655b-62c0-4de9-94ec-8313c7ad658d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:45.174959 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c95f655b-62c0-4de9-94ec-8313c7ad658d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:45.176466 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c95f655b-62c0-4de9-94ec-8313c7ad658d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:45.177081 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c95f655b-62c0-4de9-94ec-8313c7ad658d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:45.177663 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c95f655b-62c0-4de9-94ec-8313c7ad658d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:45.190225 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66fe39f2-0a6d-4de4-ab17-4ad73fdc93fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:45.191724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66fe39f2-0a6d-4de4-ab17-4ad73fdc93fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:45.192329 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66fe39f2-0a6d-4de4-ab17-4ad73fdc93fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:45.192943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-66fe39f2-0a6d-4de4-ab17-4ad73fdc93fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lazy-loading 'fault' on Instance uuid 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:42:45.260680 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-66fe39f2-0a6d-4de4-ab17-4ad73fdc93fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:45.268961 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-66fe39f2-0a6d-4de4-ab17-4ad73fdc93fd tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 200 len: 1311 microversion: 2.1 time: 0.190972 Sep 27 16:42:45.270137 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 383/803] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:45 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 1311 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:42:45.275621 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8c3b5ee4-2cab-4671-b951-fe4a5a6f50f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7042befe-e5c3-4eb8-991d-fa872ae36701"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:42:45.278454 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8c3b5ee4-2cab-4671-b951-fe4a5a6f50f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:45.280890 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c95f655b-62c0-4de9-94ec-8313c7ad658d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:45.287382 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c3b5ee4-2cab-4671-b951-fe4a5a6f50f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:45.293471 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c3b5ee4-2cab-4671-b951-fe4a5a6f50f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:45.293471 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c3b5ee4-2cab-4671-b951-fe4a5a6f50f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:45.293471 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c3b5ee4-2cab-4671-b951-fe4a5a6f50f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:45.293471 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c3b5ee4-2cab-4671-b951-fe4a5a6f50f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:45.293942 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c3b5ee4-2cab-4671-b951-fe4a5a6f50f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:45.294033 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c95f655b-62c0-4de9-94ec-8313c7ad658d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1144 microversion: 2.1 time: 0.133704 Sep 27 16:42:45.303465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 421/804] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:45 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1144 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:46.297335 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-dcb58867-1f29-4b70-9fc7-29f6c1552625 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:46.298627 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-dcb58867-1f29-4b70-9fc7-29f6c1552625 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:46.305630 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dcb58867-1f29-4b70-9fc7-29f6c1552625 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:46.306156 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dcb58867-1f29-4b70-9fc7-29f6c1552625 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:46.306601 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dcb58867-1f29-4b70-9fc7-29f6c1552625 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:46.307341 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dcb58867-1f29-4b70-9fc7-29f6c1552625 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:46.307852 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dcb58867-1f29-4b70-9fc7-29f6c1552625 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:46.308273 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dcb58867-1f29-4b70-9fc7-29f6c1552625 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:46.324458 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-dcb58867-1f29-4b70-9fc7-29f6c1552625 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] HTTP exception thrown: Instance 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 could not be found. Sep 27 16:42:46.326254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-dcb58867-1f29-4b70-9fc7-29f6c1552625 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Request method failure captured: Sep 27 16:42:46.326254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 HTTP/1.1 Sep 27 16:42:46.326254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:42:46.326254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:42:46.326254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:42:46.326254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:42:46.326254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:42:46.326254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:42:46.326254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:42:46.326254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:42:46.326254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMybbp91lepYQw85tUquWCV9UR5RezmQYrVfqE15tUFFE5y2X68s4nmn2P-J26dEvIkXNr6K7LpWu32utpxO1WVZFPVbAUVkBy8ED55Dss_89HF5N9IwPzLh5PE1Lkzf5zU-RvYh05UuJNz1vky_4nFLpZn78rK0k61y3SURPRT-cpXI Sep 27 16:42:46.326254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:42:46.326254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:42:46.326254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:42:46.326254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:42:46.326254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:42:46.326254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:42:46.326254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 9288b4e62bc945479636aec307a98746 Sep 27 16:42:46.326254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-54837262 Sep 27 16:42:46.326254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:42:46.326254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:42:46.327973 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9288b4e62bc945479636aec307a98746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9288b4e62bc945479636aec307a98746"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9288b4e62bc945479636aec307a98746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9288b4e62bc945479636aec307a98746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:42:46.327973 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-ServerRescueNegativeTestJSON-54837262 Sep 27 16:42:46.327973 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 9288b4e62bc945479636aec307a98746 Sep 27 16:42:46.327973 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-54837262 Sep 27 16:42:46.327973 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-ServerRescueNegativeTestJSON-54837262-project Sep 27 16:42:46.327973 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:42:46.327973 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:42:46.327973 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: 2f9e55a3ff7c424dbd7a58f0eb92b8ce Sep 27 16:42:46.327973 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-ServerRescueNegativeTestJSON-54837262-project Sep 27 16:42:46.327973 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:42:46.327973 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Instance 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 could not be found. Sep 27 16:42:46.327973 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': '2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666'} Sep 27 16:42:46.329193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:42:46.329193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:42:46.329193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:42:46.329193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:42:46.329193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:42:46.329193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:42:46.329193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:42:46.329193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:42:46.329193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:42:46.329193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:42:46.329193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 could not be found. Sep 27 16:42:46.329193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:42:46.329193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:42:46.329193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:42:46.329193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:42:46.329193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:42:46.329193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:42:46.329193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:42:46.329193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:42:46.329193 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:42:46.331875 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:42:46.331875 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:42:46.331875 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:42:46.331875 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:42:46.331875 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:42:46.331875 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:42:46.331875 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:42:46.331875 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 could not be found. Sep 27 16:42:46.331875 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:42:46.331875 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:42:46.331875 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:42:46.331875 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:42:46.331875 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:42:46.331875 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:42:46.331875 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:42:46.331875 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:42:46.331875 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 could not be found. Sep 27 16:42:46.331875 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:42:46.334039 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-dcb58867-1f29-4b70-9fc7-29f6c1552625 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Returning 404 to user: Instance 2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:42:46.334039 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-dcb58867-1f29-4b70-9fc7-29f6c1552625 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666" status: 404 len: 111 microversion: 2.1 time: 0.035757 Sep 27 16:42:46.334039 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 422/805] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:46 2022] GET /compute/v2.1/servers/2b14ca9e-9eaf-49ff-9b5c-190bc7f1b666 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:42:46.338852 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8c2a6a17-9ea1-4714-99ad-f543746a7448 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:46.339482 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8c2a6a17-9ea1-4714-99ad-f543746a7448 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:46.346699 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c2a6a17-9ea1-4714-99ad-f543746a7448 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:46.347468 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c2a6a17-9ea1-4714-99ad-f543746a7448 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:46.348692 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c2a6a17-9ea1-4714-99ad-f543746a7448 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:46.349706 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c2a6a17-9ea1-4714-99ad-f543746a7448 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:46.350374 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c2a6a17-9ea1-4714-99ad-f543746a7448 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:46.351037 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c2a6a17-9ea1-4714-99ad-f543746a7448 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:46.426030 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8c2a6a17-9ea1-4714-99ad-f543746a7448 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:46.434261 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8c2a6a17-9ea1-4714-99ad-f543746a7448 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1192 microversion: 2.1 time: 0.102902 Sep 27 16:42:46.450768 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 423/806] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:46 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1192 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:46.450768 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c5048b30-2845-4c9d-8f03-b40864ea545b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:46.450768 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c5048b30-2845-4c9d-8f03-b40864ea545b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:46.450768 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5048b30-2845-4c9d-8f03-b40864ea545b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:46.451363 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5048b30-2845-4c9d-8f03-b40864ea545b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:46.451363 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5048b30-2845-4c9d-8f03-b40864ea545b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:46.451363 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5048b30-2845-4c9d-8f03-b40864ea545b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:46.451363 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5048b30-2845-4c9d-8f03-b40864ea545b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:46.451694 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5048b30-2845-4c9d-8f03-b40864ea545b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:46.476738 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c5048b30-2845-4c9d-8f03-b40864ea545b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 16:42:46.773467 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8c3b5ee4-2cab-4671-b951-fe4a5a6f50f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "POST /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.499139 Sep 27 16:42:46.773467 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 384/807] 10.222.0.64 () {62 vars in 1364 bytes} [Tue Sep 27 16:42:45 2022] POST /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac/os-volume_attachments => generated 188 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 16:42:46.774550 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c5048b30-2845-4c9d-8f03-b40864ea545b tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "DELETE /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 204 len: 0 microversion: 2.1 time: 0.338390 Sep 27 16:42:46.777933 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 424/808] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:42:46 2022] DELETE /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 16:42:46.909123 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b0e60279-296e-48b6-8e4e-6a4c14a045fe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:46.915253 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b0e60279-296e-48b6-8e4e-6a4c14a045fe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:46.916424 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0e60279-296e-48b6-8e4e-6a4c14a045fe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:46.916909 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0e60279-296e-48b6-8e4e-6a4c14a045fe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:46.917342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0e60279-296e-48b6-8e4e-6a4c14a045fe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:46.918090 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0e60279-296e-48b6-8e4e-6a4c14a045fe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:46.918699 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0e60279-296e-48b6-8e4e-6a4c14a045fe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:46.919148 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0e60279-296e-48b6-8e4e-6a4c14a045fe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:46.940638 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-69570657-428b-439b-a638-14edfbb6d2f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:46.942167 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-69570657-428b-439b-a638-14edfbb6d2f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:46.950401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69570657-428b-439b-a638-14edfbb6d2f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:46.951222 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69570657-428b-439b-a638-14edfbb6d2f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:46.951767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69570657-428b-439b-a638-14edfbb6d2f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:46.952798 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69570657-428b-439b-a638-14edfbb6d2f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:46.953426 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69570657-428b-439b-a638-14edfbb6d2f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:46.954082 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69570657-428b-439b-a638-14edfbb6d2f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:47.237211 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b0e60279-296e-48b6-8e4e-6a4c14a045fe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:47.252326 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b0e60279-296e-48b6-8e4e-6a4c14a045fe tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.467119 Sep 27 16:42:47.252326 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 385/809] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:46 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:47.459454 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e4ad6b39-e209-4892-ad21-9f215e0af5bd tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:47.460258 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e4ad6b39-e209-4892-ad21-9f215e0af5bd tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:47.466391 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4ad6b39-e209-4892-ad21-9f215e0af5bd tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:47.469324 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4ad6b39-e209-4892-ad21-9f215e0af5bd tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:47.469324 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4ad6b39-e209-4892-ad21-9f215e0af5bd tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:47.469324 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4ad6b39-e209-4892-ad21-9f215e0af5bd tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:47.469324 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4ad6b39-e209-4892-ad21-9f215e0af5bd tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:47.469717 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4ad6b39-e209-4892-ad21-9f215e0af5bd tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:47.533143 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e4ad6b39-e209-4892-ad21-9f215e0af5bd tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:47.545358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e4ad6b39-e209-4892-ad21-9f215e0af5bd tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1200 microversion: 2.1 time: 0.090109 Sep 27 16:42:47.546029 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 386/810] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:47 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1200 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:47.603926 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-69570657-428b-439b-a638-14edfbb6d2f3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "DELETE /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac/os-volume_attachments/7042befe-e5c3-4eb8-991d-fa872ae36701" status: 202 len: 0 microversion: 2.20 time: 0.672997 Sep 27 16:42:47.604579 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 425/811] 10.222.0.64 () {60 vars in 1457 bytes} [Tue Sep 27 16:42:46 2022] DELETE /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac/os-volume_attachments/7042befe-e5c3-4eb8-991d-fa872ae36701 => generated 0 bytes in 675 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 27 16:42:47.667301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-14c51e0b-8943-4cbd-9fbc-723d4af5f353 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:42:47.668133 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-14c51e0b-8943-4cbd-9fbc-723d4af5f353 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:47.675409 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-14c51e0b-8943-4cbd-9fbc-723d4af5f353 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:47.675981 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-14c51e0b-8943-4cbd-9fbc-723d4af5f353 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:47.676415 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-14c51e0b-8943-4cbd-9fbc-723d4af5f353 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:47.677109 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-14c51e0b-8943-4cbd-9fbc-723d4af5f353 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:47.677554 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-14c51e0b-8943-4cbd-9fbc-723d4af5f353 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:47.677967 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-14c51e0b-8943-4cbd-9fbc-723d4af5f353 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:47.706842 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-14c51e0b-8943-4cbd-9fbc-723d4af5f353 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127617) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 27 16:42:47.985557 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-14c51e0b-8943-4cbd-9fbc-723d4af5f353 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "POST /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac/action" status: 202 len: 0 microversion: 2.20 time: 0.323007 Sep 27 16:42:47.986256 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 387/812] 10.222.0.64 () {62 vars in 1319 bytes} [Tue Sep 27 16:42:47 2022] POST /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 16:42:47.995232 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c482fc10-7ca2-4a07-b884-79edc14148db tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:47.995845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c482fc10-7ca2-4a07-b884-79edc14148db tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:47.997811 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:48.002709 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c482fc10-7ca2-4a07-b884-79edc14148db tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:48.003254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c482fc10-7ca2-4a07-b884-79edc14148db tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:48.003698 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c482fc10-7ca2-4a07-b884-79edc14148db tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:48.004898 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c482fc10-7ca2-4a07-b884-79edc14148db tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:48.005531 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c482fc10-7ca2-4a07-b884-79edc14148db tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:48.005957 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c482fc10-7ca2-4a07-b884-79edc14148db tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:48.152732 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c482fc10-7ca2-4a07-b884-79edc14148db tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:48.161094 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c482fc10-7ca2-4a07-b884-79edc14148db tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:48.162517 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c482fc10-7ca2-4a07-b884-79edc14148db tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:48.163724 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c482fc10-7ca2-4a07-b884-79edc14148db tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1673 microversion: 2.20 time: 0.172400 Sep 27 16:42:48.164283 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 426/813] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:47 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:48.272766 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4dfff0f1-82a5-4628-8ca3-5391d0dc4bde tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:48.273288 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4dfff0f1-82a5-4628-8ca3-5391d0dc4bde tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:48.279407 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4dfff0f1-82a5-4628-8ca3-5391d0dc4bde tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:48.280142 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4dfff0f1-82a5-4628-8ca3-5391d0dc4bde tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:48.280565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4dfff0f1-82a5-4628-8ca3-5391d0dc4bde tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:48.281251 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4dfff0f1-82a5-4628-8ca3-5391d0dc4bde tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:48.281710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4dfff0f1-82a5-4628-8ca3-5391d0dc4bde tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:48.282162 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4dfff0f1-82a5-4628-8ca3-5391d0dc4bde tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:48.454274 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4dfff0f1-82a5-4628-8ca3-5391d0dc4bde tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:48.467169 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4dfff0f1-82a5-4628-8ca3-5391d0dc4bde tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.199765 Sep 27 16:42:48.482310 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 388/814] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:48 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:48.570559 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b70cf79d-e562-40c3-a775-b917e3cdcf04 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:48.571202 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b70cf79d-e562-40c3-a775-b917e3cdcf04 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:48.577119 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b70cf79d-e562-40c3-a775-b917e3cdcf04 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:48.577607 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b70cf79d-e562-40c3-a775-b917e3cdcf04 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:48.578048 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b70cf79d-e562-40c3-a775-b917e3cdcf04 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:48.578739 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b70cf79d-e562-40c3-a775-b917e3cdcf04 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:48.579233 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b70cf79d-e562-40c3-a775-b917e3cdcf04 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:48.579663 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b70cf79d-e562-40c3-a775-b917e3cdcf04 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:48.646745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b70cf79d-e562-40c3-a775-b917e3cdcf04 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:48.655302 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b70cf79d-e562-40c3-a775-b917e3cdcf04 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1200 microversion: 2.1 time: 0.089861 Sep 27 16:42:48.655884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 427/815] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:48 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1200 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:49.194643 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8876ea65-24e9-41b7-ac0f-50a20b29918f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:49.195301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8876ea65-24e9-41b7-ac0f-50a20b29918f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:49.201225 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8876ea65-24e9-41b7-ac0f-50a20b29918f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:49.201703 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8876ea65-24e9-41b7-ac0f-50a20b29918f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:49.202134 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8876ea65-24e9-41b7-ac0f-50a20b29918f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:49.208924 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8876ea65-24e9-41b7-ac0f-50a20b29918f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:49.208924 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8876ea65-24e9-41b7-ac0f-50a20b29918f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:49.208924 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8876ea65-24e9-41b7-ac0f-50a20b29918f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:49.208924 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:49.336385 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8876ea65-24e9-41b7-ac0f-50a20b29918f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:49.346717 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8876ea65-24e9-41b7-ac0f-50a20b29918f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:49.349129 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8876ea65-24e9-41b7-ac0f-50a20b29918f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:49.350461 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8876ea65-24e9-41b7-ac0f-50a20b29918f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1673 microversion: 2.20 time: 0.159901 Sep 27 16:42:49.351115 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 389/816] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:49 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:49.490192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b013f9a9-e949-444a-b935-0c99e0c83333 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:49.490958 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b013f9a9-e949-444a-b935-0c99e0c83333 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:49.497123 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b013f9a9-e949-444a-b935-0c99e0c83333 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:49.497612 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b013f9a9-e949-444a-b935-0c99e0c83333 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:49.498046 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b013f9a9-e949-444a-b935-0c99e0c83333 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:49.498746 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b013f9a9-e949-444a-b935-0c99e0c83333 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:49.499227 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b013f9a9-e949-444a-b935-0c99e0c83333 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:49.499647 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b013f9a9-e949-444a-b935-0c99e0c83333 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:49.515637 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:49.636473 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b013f9a9-e949-444a-b935-0c99e0c83333 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:49.644044 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b013f9a9-e949-444a-b935-0c99e0c83333 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.158434 Sep 27 16:42:49.645205 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 428/817] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:49 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:49.677395 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-55837daa-e775-4669-9a0e-8421a0b61d87 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:49.677991 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-55837daa-e775-4669-9a0e-8421a0b61d87 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:49.684606 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-55837daa-e775-4669-9a0e-8421a0b61d87 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:49.685225 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-55837daa-e775-4669-9a0e-8421a0b61d87 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:49.685667 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-55837daa-e775-4669-9a0e-8421a0b61d87 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:49.686351 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-55837daa-e775-4669-9a0e-8421a0b61d87 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:49.686816 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-55837daa-e775-4669-9a0e-8421a0b61d87 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:49.687235 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-55837daa-e775-4669-9a0e-8421a0b61d87 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:49.757867 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-55837daa-e775-4669-9a0e-8421a0b61d87 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:49.765589 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-55837daa-e775-4669-9a0e-8421a0b61d87 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1200 microversion: 2.1 time: 0.092155 Sep 27 16:42:49.766143 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 390/818] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:49 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1200 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:50.377153 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ed44ec08-efc5-4cb9-94cc-d2398ba0d589 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:50.378439 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ed44ec08-efc5-4cb9-94cc-d2398ba0d589 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:50.389184 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ed44ec08-efc5-4cb9-94cc-d2398ba0d589 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:50.390973 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ed44ec08-efc5-4cb9-94cc-d2398ba0d589 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:50.390973 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ed44ec08-efc5-4cb9-94cc-d2398ba0d589 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:50.391823 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ed44ec08-efc5-4cb9-94cc-d2398ba0d589 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:50.392489 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ed44ec08-efc5-4cb9-94cc-d2398ba0d589 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:50.393117 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ed44ec08-efc5-4cb9-94cc-d2398ba0d589 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:50.538324 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ed44ec08-efc5-4cb9-94cc-d2398ba0d589 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:50.546995 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ed44ec08-efc5-4cb9-94cc-d2398ba0d589 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:50.548672 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ed44ec08-efc5-4cb9-94cc-d2398ba0d589 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:50.549846 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ed44ec08-efc5-4cb9-94cc-d2398ba0d589 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1675 microversion: 2.20 time: 0.177734 Sep 27 16:42:50.550410 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 429/819] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:50 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1675 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:50.668103 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-28a89422-c2a5-433d-be6b-569df126e3c7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:50.668711 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-28a89422-c2a5-433d-be6b-569df126e3c7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:50.675428 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28a89422-c2a5-433d-be6b-569df126e3c7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:50.676255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28a89422-c2a5-433d-be6b-569df126e3c7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:50.676753 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28a89422-c2a5-433d-be6b-569df126e3c7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:50.677821 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28a89422-c2a5-433d-be6b-569df126e3c7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:50.678500 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28a89422-c2a5-433d-be6b-569df126e3c7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:50.679037 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-28a89422-c2a5-433d-be6b-569df126e3c7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:50.792078 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-df10d122-d7c4-442f-a028-f9a204d4f46b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:50.793524 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-df10d122-d7c4-442f-a028-f9a204d4f46b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:50.802242 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df10d122-d7c4-442f-a028-f9a204d4f46b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:50.808839 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df10d122-d7c4-442f-a028-f9a204d4f46b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:50.808839 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df10d122-d7c4-442f-a028-f9a204d4f46b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:50.808839 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df10d122-d7c4-442f-a028-f9a204d4f46b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:50.808839 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df10d122-d7c4-442f-a028-f9a204d4f46b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:50.809287 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df10d122-d7c4-442f-a028-f9a204d4f46b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:50.827121 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-28a89422-c2a5-433d-be6b-569df126e3c7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:50.836552 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-28a89422-c2a5-433d-be6b-569df126e3c7 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1523 microversion: 2.1 time: 0.172172 Sep 27 16:42:50.843242 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 391/820] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:50 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:50.877426 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-df10d122-d7c4-442f-a028-f9a204d4f46b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:50.886158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-df10d122-d7c4-442f-a028-f9a204d4f46b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1210 microversion: 2.1 time: 0.100739 Sep 27 16:42:50.886735 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 430/821] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:50 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1210 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:42:51.198029 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-a4282032-6709-4a16-a87d-9a0cc6166a8a req-a7d3d057-e3a0-4814-8562-94f281310054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35d1f4b1-f536-4f56-8c18-400be343444b", "name": "network-vif-deleted", "tag": "9a2e9512-fd72-4935-9024-5d91227158e5"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:42:51.216869 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a4282032-6709-4a16-a87d-9a0cc6166a8a req-a7d3d057-e3a0-4814-8562-94f281310054 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:51.217603 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a4282032-6709-4a16-a87d-9a0cc6166a8a req-a7d3d057-e3a0-4814-8562-94f281310054 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:51.218185 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a4282032-6709-4a16-a87d-9a0cc6166a8a req-a7d3d057-e3a0-4814-8562-94f281310054 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:51.248394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-a4282032-6709-4a16-a87d-9a0cc6166a8a req-a7d3d057-e3a0-4814-8562-94f281310054 service nova] Creating event network-vif-deleted:9a2e9512-fd72-4935-9024-5d91227158e5 for instance 35d1f4b1-f536-4f56-8c18-400be343444b on hv-cinder-85506 Sep 27 16:42:51.277218 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-a4282032-6709-4a16-a87d-9a0cc6166a8a req-a7d3d057-e3a0-4814-8562-94f281310054 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082867 Sep 27 16:42:51.280194 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 392/822] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:42:51.348719 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2c746980-ab81-4ea2-a585-954802ade0cf tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:51.349215 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2c746980-ab81-4ea2-a585-954802ade0cf tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:51.355930 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c746980-ab81-4ea2-a585-954802ade0cf tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:51.356426 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c746980-ab81-4ea2-a585-954802ade0cf tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:51.356861 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c746980-ab81-4ea2-a585-954802ade0cf tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:51.357569 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c746980-ab81-4ea2-a585-954802ade0cf tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:51.358018 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c746980-ab81-4ea2-a585-954802ade0cf tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:51.364464 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c746980-ab81-4ea2-a585-954802ade0cf tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:51.397149 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2c746980-ab81-4ea2-a585-954802ade0cf tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4/ips" status: 200 len: 148 microversion: 2.1 time: 0.052250 Sep 27 16:42:51.408139 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 431/823] 10.222.0.64 () {58 vars in 1248 bytes} [Tue Sep 27 16:42:51 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4/ips => generated 148 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:42:51.580643 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-edb23848-ec34-4f78-b2fb-03b8f2998eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:51.581585 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-edb23848-ec34-4f78-b2fb-03b8f2998eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:51.589322 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-edb23848-ec34-4f78-b2fb-03b8f2998eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:51.589816 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-edb23848-ec34-4f78-b2fb-03b8f2998eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:51.590244 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-edb23848-ec34-4f78-b2fb-03b8f2998eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:51.590971 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-edb23848-ec34-4f78-b2fb-03b8f2998eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:51.596456 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-edb23848-ec34-4f78-b2fb-03b8f2998eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:51.611626 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-edb23848-ec34-4f78-b2fb-03b8f2998eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:51.862317 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7a77dd88-5317-4419-9f7d-fd5813672749 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:51.862978 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7a77dd88-5317-4419-9f7d-fd5813672749 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:51.870648 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7a77dd88-5317-4419-9f7d-fd5813672749 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:51.871194 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7a77dd88-5317-4419-9f7d-fd5813672749 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:51.871605 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7a77dd88-5317-4419-9f7d-fd5813672749 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:51.872594 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7a77dd88-5317-4419-9f7d-fd5813672749 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:51.873259 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7a77dd88-5317-4419-9f7d-fd5813672749 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:51.873970 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7a77dd88-5317-4419-9f7d-fd5813672749 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:51.913906 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7a77dd88-5317-4419-9f7d-fd5813672749 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:51.914407 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7a77dd88-5317-4419-9f7d-fd5813672749 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:51.914867 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7a77dd88-5317-4419-9f7d-fd5813672749 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:51.915520 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-7a77dd88-5317-4419-9f7d-fd5813672749 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lazy-loading 'fault' on Instance uuid 35d1f4b1-f536-4f56-8c18-400be343444b {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:42:51.924662 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-edb23848-ec34-4f78-b2fb-03b8f2998eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:51.935638 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-edb23848-ec34-4f78-b2fb-03b8f2998eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:51.938542 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-edb23848-ec34-4f78-b2fb-03b8f2998eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:51.940445 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-edb23848-ec34-4f78-b2fb-03b8f2998eb1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1731 microversion: 2.20 time: 0.365499 Sep 27 16:42:51.941389 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 393/824] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:51 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1731 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:51.947789 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-96a8cec1-f7e2-4fce-b0e6-ab7e760fe92b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:51.948870 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-96a8cec1-f7e2-4fce-b0e6-ab7e760fe92b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:51.956493 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96a8cec1-f7e2-4fce-b0e6-ab7e760fe92b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:51.957222 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96a8cec1-f7e2-4fce-b0e6-ab7e760fe92b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:51.962687 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96a8cec1-f7e2-4fce-b0e6-ab7e760fe92b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:51.962687 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96a8cec1-f7e2-4fce-b0e6-ab7e760fe92b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:51.962687 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96a8cec1-f7e2-4fce-b0e6-ab7e760fe92b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:51.962687 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96a8cec1-f7e2-4fce-b0e6-ab7e760fe92b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:52.295934 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7a77dd88-5317-4419-9f7d-fd5813672749 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f9e55a3ff7c424dbd7a58f0eb92b8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9288b4e62bc945479636aec307a98746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:52.306177 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7a77dd88-5317-4419-9f7d-fd5813672749 tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 200 len: 1312 microversion: 2.1 time: 0.449782 Sep 27 16:42:52.319982 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 432/825] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:51 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 1312 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:42:52.437275 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-96a8cec1-f7e2-4fce-b0e6-ab7e760fe92b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:52.448651 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-96a8cec1-f7e2-4fce-b0e6-ab7e760fe92b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.503839 Sep 27 16:42:52.449750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 394/826] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:51 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:52.967228 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7583832a-79b3-4fc4-92f1-ab1a8e5568e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:52.968042 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7583832a-79b3-4fc4-92f1-ab1a8e5568e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:52.978669 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7583832a-79b3-4fc4-92f1-ab1a8e5568e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:52.979269 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7583832a-79b3-4fc4-92f1-ab1a8e5568e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:52.981014 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7583832a-79b3-4fc4-92f1-ab1a8e5568e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:52.981014 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7583832a-79b3-4fc4-92f1-ab1a8e5568e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:52.981014 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7583832a-79b3-4fc4-92f1-ab1a8e5568e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:52.981270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7583832a-79b3-4fc4-92f1-ab1a8e5568e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:53.128918 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7583832a-79b3-4fc4-92f1-ab1a8e5568e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:53.137477 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7583832a-79b3-4fc4-92f1-ab1a8e5568e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:53.138973 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7583832a-79b3-4fc4-92f1-ab1a8e5568e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:53.140113 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7583832a-79b3-4fc4-92f1-ab1a8e5568e3 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1731 microversion: 2.20 time: 0.177077 Sep 27 16:42:53.140668 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 433/827] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:52 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:53.298457 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-866e8f91-24c0-4306-9b11-fcc07849ac69 req-b321a510-109f-4842-820d-b4153b2d33b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50687ace-d869-4712-9cf7-0d16c7244ac7", "tag": "bfce7c0e-1dc8-42b2-b518-7b30f07592fc"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:42:53.308536 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:53.311020 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-866e8f91-24c0-4306-9b11-fcc07849ac69 req-b321a510-109f-4842-820d-b4153b2d33b9 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:53.311520 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-866e8f91-24c0-4306-9b11-fcc07849ac69 req-b321a510-109f-4842-820d-b4153b2d33b9 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:53.312138 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-866e8f91-24c0-4306-9b11-fcc07849ac69 req-b321a510-109f-4842-820d-b4153b2d33b9 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:53.323894 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-866e8f91-24c0-4306-9b11-fcc07849ac69 req-b321a510-109f-4842-820d-b4153b2d33b9 service nova] Creating event network-changed:bfce7c0e-1dc8-42b2-b518-7b30f07592fc for instance 50687ace-d869-4712-9cf7-0d16c7244ac7 on hv-cinder-85506 Sep 27 16:42:53.330009 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-866e8f91-24c0-4306-9b11-fcc07849ac69 req-b321a510-109f-4842-820d-b4153b2d33b9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035444 Sep 27 16:42:53.331850 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e6f6b7d8-95ae-4ee9-b555-3738778dca9d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:53.332657 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e6f6b7d8-95ae-4ee9-b555-3738778dca9d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] [instance: 35d1f4b1-f536-4f56-8c18-400be343444b] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:53.333639 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 395/828] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:42:53.338761 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6f6b7d8-95ae-4ee9-b555-3738778dca9d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:53.339280 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6f6b7d8-95ae-4ee9-b555-3738778dca9d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:53.339720 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6f6b7d8-95ae-4ee9-b555-3738778dca9d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:53.340503 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6f6b7d8-95ae-4ee9-b555-3738778dca9d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:53.340982 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6f6b7d8-95ae-4ee9-b555-3738778dca9d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:53.341409 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6f6b7d8-95ae-4ee9-b555-3738778dca9d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:53.378432 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-e6f6b7d8-95ae-4ee9-b555-3738778dca9d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] HTTP exception thrown: Instance 35d1f4b1-f536-4f56-8c18-400be343444b could not be found. Sep 27 16:42:53.380262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e6f6b7d8-95ae-4ee9-b555-3738778dca9d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Request method failure captured: Sep 27 16:42:53.380262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b HTTP/1.1 Sep 27 16:42:53.380262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:42:53.380262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:42:53.380262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:42:53.380262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:42:53.380262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:42:53.380262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:42:53.380262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:42:53.380262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:42:53.380262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMybbp91lepYQw85tUquWCV9UR5RezmQYrVfqE15tUFFE5y2X68s4nmn2P-J26dEvIkXNr6K7LpWu32utpxO1WVZFPVbAUVkBy8ED55Dss_89HF5N9IwPzLh5PE1Lkzf5zU-RvYh05UuJNz1vky_4nFLpZn78rK0k61y3SURPRT-cpXI Sep 27 16:42:53.380262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:42:53.380262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:42:53.380262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:42:53.380262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:42:53.380262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:42:53.380262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:42:53.380262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 9288b4e62bc945479636aec307a98746 Sep 27 16:42:53.380262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-54837262 Sep 27 16:42:53.380262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:42:53.380262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:42:53.381603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9288b4e62bc945479636aec307a98746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9288b4e62bc945479636aec307a98746"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9288b4e62bc945479636aec307a98746"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9288b4e62bc945479636aec307a98746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:42:53.381603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-ServerRescueNegativeTestJSON-54837262 Sep 27 16:42:53.381603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 9288b4e62bc945479636aec307a98746 Sep 27 16:42:53.381603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-54837262 Sep 27 16:42:53.381603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-ServerRescueNegativeTestJSON-54837262-project Sep 27 16:42:53.381603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:42:53.381603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:42:53.381603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: 2f9e55a3ff7c424dbd7a58f0eb92b8ce Sep 27 16:42:53.381603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-ServerRescueNegativeTestJSON-54837262-project Sep 27 16:42:53.381603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:42:53.381603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Instance 35d1f4b1-f536-4f56-8c18-400be343444b could not be found. Sep 27 16:42:53.381603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': '35d1f4b1-f536-4f56-8c18-400be343444b'} Sep 27 16:42:53.382494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:42:53.382494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:42:53.382494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:42:53.382494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:42:53.382494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:42:53.382494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:42:53.382494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:42:53.382494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:42:53.382494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:42:53.382494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:42:53.382494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35d1f4b1-f536-4f56-8c18-400be343444b could not be found. Sep 27 16:42:53.382494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:42:53.382494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:42:53.382494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:42:53.382494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:42:53.382494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:42:53.382494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:42:53.382494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:42:53.382494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:42:53.382494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:42:53.384383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:42:53.384383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:42:53.384383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:42:53.384383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:42:53.384383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:42:53.384383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:42:53.384383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:42:53.384383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35d1f4b1-f536-4f56-8c18-400be343444b could not be found. Sep 27 16:42:53.384383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:42:53.384383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:42:53.384383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:42:53.384383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:42:53.384383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:42:53.384383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:42:53.384383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:42:53.384383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:42:53.384383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35d1f4b1-f536-4f56-8c18-400be343444b could not be found. Sep 27 16:42:53.384383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:42:53.388406 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e6f6b7d8-95ae-4ee9-b555-3738778dca9d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] Returning 404 to user: Instance 35d1f4b1-f536-4f56-8c18-400be343444b could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:42:53.388406 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e6f6b7d8-95ae-4ee9-b555-3738778dca9d tempest-ServerRescueNegativeTestJSON-54837262 tempest-ServerRescueNegativeTestJSON-54837262-project] 10.222.0.64 "GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b" status: 404 len: 111 microversion: 2.1 time: 0.054131 Sep 27 16:42:53.388406 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 434/829] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:53 2022] GET /compute/v2.1/servers/35d1f4b1-f536-4f56-8c18-400be343444b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 16:42:53.439954 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:53.446127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-114c1653-cfdc-4f09-b34a-5e52226542a6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "586298d7-4fdc-4c33-8364-767825cea741"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:42:53.449076 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-114c1653-cfdc-4f09-b34a-5e52226542a6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:53.456024 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-114c1653-cfdc-4f09-b34a-5e52226542a6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:53.456510 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-114c1653-cfdc-4f09-b34a-5e52226542a6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:53.457094 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-114c1653-cfdc-4f09-b34a-5e52226542a6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:53.458361 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-114c1653-cfdc-4f09-b34a-5e52226542a6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:53.459027 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-114c1653-cfdc-4f09-b34a-5e52226542a6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:53.459466 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-114c1653-cfdc-4f09-b34a-5e52226542a6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:53.472190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8bbdeba8-2d85-4df5-b56f-83776fdb8cb9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:53.473670 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8bbdeba8-2d85-4df5-b56f-83776fdb8cb9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:53.482797 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8bbdeba8-2d85-4df5-b56f-83776fdb8cb9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:53.489009 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8bbdeba8-2d85-4df5-b56f-83776fdb8cb9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:53.489009 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8bbdeba8-2d85-4df5-b56f-83776fdb8cb9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:53.489009 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8bbdeba8-2d85-4df5-b56f-83776fdb8cb9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:53.489009 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8bbdeba8-2d85-4df5-b56f-83776fdb8cb9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:53.489367 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8bbdeba8-2d85-4df5-b56f-83776fdb8cb9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:53.679570 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8bbdeba8-2d85-4df5-b56f-83776fdb8cb9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:53.689520 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8bbdeba8-2d85-4df5-b56f-83776fdb8cb9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.220056 Sep 27 16:42:53.690678 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 435/830] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:53 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:42:54.104884 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=12 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:42:54.166490 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ddca2f70-1493-4bf9-80f9-b8a77355e90f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:54.167181 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ddca2f70-1493-4bf9-80f9-b8a77355e90f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:54.180046 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ddca2f70-1493-4bf9-80f9-b8a77355e90f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:54.181228 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ddca2f70-1493-4bf9-80f9-b8a77355e90f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:54.182102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ddca2f70-1493-4bf9-80f9-b8a77355e90f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:54.183267 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ddca2f70-1493-4bf9-80f9-b8a77355e90f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:54.184031 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ddca2f70-1493-4bf9-80f9-b8a77355e90f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:54.184763 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ddca2f70-1493-4bf9-80f9-b8a77355e90f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:54.546642 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ddca2f70-1493-4bf9-80f9-b8a77355e90f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:54.555917 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ddca2f70-1493-4bf9-80f9-b8a77355e90f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:54.557681 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ddca2f70-1493-4bf9-80f9-b8a77355e90f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:54.559229 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ddca2f70-1493-4bf9-80f9-b8a77355e90f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1731 microversion: 2.20 time: 0.396789 Sep 27 16:42:54.559861 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 436/831] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:54 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1731 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:42:54.720337 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f199e4b1-6643-439d-9a1b-031cb8d93ebe tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:54.721241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f199e4b1-6643-439d-9a1b-031cb8d93ebe tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:54.736968 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f199e4b1-6643-439d-9a1b-031cb8d93ebe tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:54.738888 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f199e4b1-6643-439d-9a1b-031cb8d93ebe tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:54.738888 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f199e4b1-6643-439d-9a1b-031cb8d93ebe tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:54.739593 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f199e4b1-6643-439d-9a1b-031cb8d93ebe tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:54.740124 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f199e4b1-6643-439d-9a1b-031cb8d93ebe tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:54.740625 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f199e4b1-6643-439d-9a1b-031cb8d93ebe tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:54.987483 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f199e4b1-6643-439d-9a1b-031cb8d93ebe tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:54.997653 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f199e4b1-6643-439d-9a1b-031cb8d93ebe tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.284726 Sep 27 16:42:54.998275 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 437/832] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:54 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:42:55.586111 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1631f007-a870-4742-9681-a86547ec3834 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:55.587677 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1631f007-a870-4742-9681-a86547ec3834 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:55.594263 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1631f007-a870-4742-9681-a86547ec3834 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:55.594986 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1631f007-a870-4742-9681-a86547ec3834 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:55.595596 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1631f007-a870-4742-9681-a86547ec3834 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:55.596527 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1631f007-a870-4742-9681-a86547ec3834 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:55.597921 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1631f007-a870-4742-9681-a86547ec3834 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:55.598641 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1631f007-a870-4742-9681-a86547ec3834 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:55.853151 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1631f007-a870-4742-9681-a86547ec3834 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:55.861625 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1631f007-a870-4742-9681-a86547ec3834 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:55.864151 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1631f007-a870-4742-9681-a86547ec3834 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:55.865288 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1631f007-a870-4742-9681-a86547ec3834 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1731 microversion: 2.20 time: 0.283610 Sep 27 16:42:55.881705 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 438/833] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:55 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1731 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:42:56.023663 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b57b8086-3bab-474f-a398-fee4c634091f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:56.024349 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b57b8086-3bab-474f-a398-fee4c634091f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:56.031750 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b57b8086-3bab-474f-a398-fee4c634091f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:56.032381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b57b8086-3bab-474f-a398-fee4c634091f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:56.032918 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b57b8086-3bab-474f-a398-fee4c634091f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:56.033725 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b57b8086-3bab-474f-a398-fee4c634091f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:56.034280 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b57b8086-3bab-474f-a398-fee4c634091f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:56.034853 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b57b8086-3bab-474f-a398-fee4c634091f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:56.564577 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b57b8086-3bab-474f-a398-fee4c634091f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:56.576685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b57b8086-3bab-474f-a398-fee4c634091f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.557595 Sep 27 16:42:56.577306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 439/834] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:56 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:42:56.896646 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-401e120c-b51b-4ab5-840e-48d5cf6bc42c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:56.897918 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-401e120c-b51b-4ab5-840e-48d5cf6bc42c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:56.905999 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-401e120c-b51b-4ab5-840e-48d5cf6bc42c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:56.906493 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-401e120c-b51b-4ab5-840e-48d5cf6bc42c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:56.907068 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-401e120c-b51b-4ab5-840e-48d5cf6bc42c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:56.907965 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-401e120c-b51b-4ab5-840e-48d5cf6bc42c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:56.909061 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-401e120c-b51b-4ab5-840e-48d5cf6bc42c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:56.909190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-401e120c-b51b-4ab5-840e-48d5cf6bc42c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:57.134607 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-401e120c-b51b-4ab5-840e-48d5cf6bc42c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:57.161039 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-401e120c-b51b-4ab5-840e-48d5cf6bc42c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:57.161039 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-401e120c-b51b-4ab5-840e-48d5cf6bc42c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:57.161039 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-401e120c-b51b-4ab5-840e-48d5cf6bc42c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1731 microversion: 2.20 time: 0.261980 Sep 27 16:42:57.161701 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 440/835] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:56 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1731 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:42:57.599874 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3c477959-b8b3-473f-9ba5-e276101a9fe2 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:57.600494 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3c477959-b8b3-473f-9ba5-e276101a9fe2 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:57.606585 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c477959-b8b3-473f-9ba5-e276101a9fe2 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:57.607111 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c477959-b8b3-473f-9ba5-e276101a9fe2 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:57.607566 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c477959-b8b3-473f-9ba5-e276101a9fe2 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:57.608266 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c477959-b8b3-473f-9ba5-e276101a9fe2 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:57.608727 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c477959-b8b3-473f-9ba5-e276101a9fe2 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:57.609159 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c477959-b8b3-473f-9ba5-e276101a9fe2 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:57.893851 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3c477959-b8b3-473f-9ba5-e276101a9fe2 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:57.905606 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3c477959-b8b3-473f-9ba5-e276101a9fe2 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.309518 Sep 27 16:42:57.908002 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 441/836] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:57 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:42:58.182053 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ee3b4bc6-a2b1-4031-997d-79a2d09854c8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:58.183316 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ee3b4bc6-a2b1-4031-997d-79a2d09854c8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:58.202398 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee3b4bc6-a2b1-4031-997d-79a2d09854c8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:58.202987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee3b4bc6-a2b1-4031-997d-79a2d09854c8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:58.203367 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee3b4bc6-a2b1-4031-997d-79a2d09854c8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:58.208523 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee3b4bc6-a2b1-4031-997d-79a2d09854c8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:58.209210 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee3b4bc6-a2b1-4031-997d-79a2d09854c8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:58.209833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee3b4bc6-a2b1-4031-997d-79a2d09854c8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:58.500320 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ee3b4bc6-a2b1-4031-997d-79a2d09854c8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:58.509711 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ee3b4bc6-a2b1-4031-997d-79a2d09854c8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:58.514001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ee3b4bc6-a2b1-4031-997d-79a2d09854c8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:58.519258 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ee3b4bc6-a2b1-4031-997d-79a2d09854c8 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1731 microversion: 2.20 time: 0.346741 Sep 27 16:42:58.520827 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 442/837] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:58 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1731 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:42:58.930603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1edb8e73-b4c4-4d1b-a379-47856ff410f3 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:58.931418 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1edb8e73-b4c4-4d1b-a379-47856ff410f3 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:58.939195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1edb8e73-b4c4-4d1b-a379-47856ff410f3 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:58.942409 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1edb8e73-b4c4-4d1b-a379-47856ff410f3 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:58.942409 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1edb8e73-b4c4-4d1b-a379-47856ff410f3 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:58.942409 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1edb8e73-b4c4-4d1b-a379-47856ff410f3 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:58.942409 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1edb8e73-b4c4-4d1b-a379-47856ff410f3 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:58.942794 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1edb8e73-b4c4-4d1b-a379-47856ff410f3 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:59.213919 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1edb8e73-b4c4-4d1b-a379-47856ff410f3 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:59.234734 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1edb8e73-b4c4-4d1b-a379-47856ff410f3 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.308846 Sep 27 16:42:59.242869 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 443/838] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:42:58 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:42:59.549642 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-320fc809-94bd-47e9-bc61-f40aefb04a6f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:42:59.550490 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-320fc809-94bd-47e9-bc61-f40aefb04a6f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:42:59.557908 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-320fc809-94bd-47e9-bc61-f40aefb04a6f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:59.558680 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-320fc809-94bd-47e9-bc61-f40aefb04a6f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:59.559091 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-320fc809-94bd-47e9-bc61-f40aefb04a6f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:59.559808 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-320fc809-94bd-47e9-bc61-f40aefb04a6f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:42:59.560276 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-320fc809-94bd-47e9-bc61-f40aefb04a6f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:42:59.560713 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-320fc809-94bd-47e9-bc61-f40aefb04a6f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:42:59.736840 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-320fc809-94bd-47e9-bc61-f40aefb04a6f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:59.755216 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-320fc809-94bd-47e9-bc61-f40aefb04a6f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:59.757210 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-320fc809-94bd-47e9-bc61-f40aefb04a6f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:42:59.758428 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-320fc809-94bd-47e9-bc61-f40aefb04a6f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1731 microversion: 2.20 time: 0.213391 Sep 27 16:42:59.774945 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 444/839] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:42:59 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:43:00.258592 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8966f402-bc1c-4b9d-9c45-d801af3ab1e8 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:00.259270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8966f402-bc1c-4b9d-9c45-d801af3ab1e8 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:00.265250 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8966f402-bc1c-4b9d-9c45-d801af3ab1e8 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:00.265740 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8966f402-bc1c-4b9d-9c45-d801af3ab1e8 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:00.266180 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8966f402-bc1c-4b9d-9c45-d801af3ab1e8 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:00.266963 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8966f402-bc1c-4b9d-9c45-d801af3ab1e8 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:00.267422 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8966f402-bc1c-4b9d-9c45-d801af3ab1e8 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:00.267850 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8966f402-bc1c-4b9d-9c45-d801af3ab1e8 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:00.504683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8966f402-bc1c-4b9d-9c45-d801af3ab1e8 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:00.504683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:00.504683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8966f402-bc1c-4b9d-9c45-d801af3ab1e8 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.231520 Sep 27 16:43:00.504683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 445/840] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:00 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:43:00.785271 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-710becf3-b3a1-472d-8b16-ccfa403acfab tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:00.786082 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-710becf3-b3a1-472d-8b16-ccfa403acfab tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:00.793648 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-710becf3-b3a1-472d-8b16-ccfa403acfab tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:00.794376 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-710becf3-b3a1-472d-8b16-ccfa403acfab tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:00.796158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-710becf3-b3a1-472d-8b16-ccfa403acfab tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:00.797403 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-710becf3-b3a1-472d-8b16-ccfa403acfab tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:00.798074 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-710becf3-b3a1-472d-8b16-ccfa403acfab tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:00.798680 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-710becf3-b3a1-472d-8b16-ccfa403acfab tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:00.996266 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-710becf3-b3a1-472d-8b16-ccfa403acfab tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:01.008204 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-710becf3-b3a1-472d-8b16-ccfa403acfab tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:01.009805 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-710becf3-b3a1-472d-8b16-ccfa403acfab tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:01.012373 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-710becf3-b3a1-472d-8b16-ccfa403acfab tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1731 microversion: 2.20 time: 0.232518 Sep 27 16:43:01.013657 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 446/841] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:43:00 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1731 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:43:01.532463 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-da41295a-02d6-4df8-8976-a88514af535f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:01.533093 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-da41295a-02d6-4df8-8976-a88514af535f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:01.539184 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-da41295a-02d6-4df8-8976-a88514af535f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:01.540422 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-da41295a-02d6-4df8-8976-a88514af535f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:01.540422 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-da41295a-02d6-4df8-8976-a88514af535f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:01.541019 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-da41295a-02d6-4df8-8976-a88514af535f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:01.541563 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-da41295a-02d6-4df8-8976-a88514af535f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:01.542016 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-da41295a-02d6-4df8-8976-a88514af535f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:01.686532 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-da41295a-02d6-4df8-8976-a88514af535f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:01.696171 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-da41295a-02d6-4df8-8976-a88514af535f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.167814 Sep 27 16:43:01.700252 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 447/842] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:01 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:43:02.041461 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a0c2b6e2-a2ca-4f62-819d-39beb266dd93 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:02.042230 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a0c2b6e2-a2ca-4f62-819d-39beb266dd93 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:02.049807 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0c2b6e2-a2ca-4f62-819d-39beb266dd93 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:02.049807 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0c2b6e2-a2ca-4f62-819d-39beb266dd93 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:02.049807 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0c2b6e2-a2ca-4f62-819d-39beb266dd93 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:02.050402 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0c2b6e2-a2ca-4f62-819d-39beb266dd93 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:02.050885 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0c2b6e2-a2ca-4f62-819d-39beb266dd93 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:02.051308 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0c2b6e2-a2ca-4f62-819d-39beb266dd93 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:02.192391 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a0c2b6e2-a2ca-4f62-819d-39beb266dd93 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:02.201148 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a0c2b6e2-a2ca-4f62-819d-39beb266dd93 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:02.202584 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a0c2b6e2-a2ca-4f62-819d-39beb266dd93 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:02.203762 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a0c2b6e2-a2ca-4f62-819d-39beb266dd93 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1731 microversion: 2.20 time: 0.166235 Sep 27 16:43:02.204325 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 448/843] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:43:02 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:43:02.698717 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-00aa5f9c-450e-4ada-95cb-a969d66bb7fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1366132809", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1242109760", "security_groups": [{"name": "tempest-secgroup-smoke-1135687175"}], "networks": [{"uuid": "2440bd4b-4ed0-4af9-98f1-31b8f95ecaf4"}], "block_device_mapping_v2": [{"uuid": "71a76f49-cf61-47be-98cd-537c27b3c037", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:43:02.817832 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-00aa5f9c-450e-4ada-95cb-a969d66bb7fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] validate_networks() for [('2440bd4b-4ed0-4af9-98f1-31b8f95ecaf4', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 16:43:03.224967 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-00aa5f9c-450e-4ada-95cb-a969d66bb7fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 16:43:03.225532 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-00aa5f9c-450e-4ada-95cb-a969d66bb7fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 16:43:03.226125 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-00aa5f9c-450e-4ada-95cb-a969d66bb7fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 16:43:03.226635 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-00aa5f9c-450e-4ada-95cb-a969d66bb7fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 16:43:03.227190 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-00aa5f9c-450e-4ada-95cb-a969d66bb7fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 16:43:03.236831 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00aa5f9c-450e-4ada-95cb-a969d66bb7fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:03.241001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00aa5f9c-450e-4ada-95cb-a969d66bb7fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:03.241001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00aa5f9c-450e-4ada-95cb-a969d66bb7fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:03.241001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00aa5f9c-450e-4ada-95cb-a969d66bb7fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:03.241001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00aa5f9c-450e-4ada-95cb-a969d66bb7fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:03.241388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00aa5f9c-450e-4ada-95cb-a969d66bb7fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:03.257702 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-00aa5f9c-450e-4ada-95cb-a969d66bb7fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Getting quotas for project eb77c9fe25cb4abda83cb3d2e665557a. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:43:03.261929 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-00aa5f9c-450e-4ada-95cb-a969d66bb7fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Getting quotas for user af5c944405e8435f9e0eccaaee764cd2 and project eb77c9fe25cb4abda83cb3d2e665557a. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:43:03.321402 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-00aa5f9c-450e-4ada-95cb-a969d66bb7fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 16:43:03.322517 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-00aa5f9c-450e-4ada-95cb-a969d66bb7fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='71a76f49-cf61-47be-98cd-537c27b3c037',volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 16:43:03.427298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-114c1653-cfdc-4f09-b34a-5e52226542a6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "POST /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.988102 Sep 27 16:43:03.427847 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 396/844] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Sep 27 16:42:53 2022] POST /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4/os-volume_attachments => generated 194 bytes in 9990 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:43:03.432844 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e8863ca3-a0c2-400c-b14f-7bbcadd35baf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:03.433814 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e8863ca3-a0c2-400c-b14f-7bbcadd35baf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:03.440161 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8863ca3-a0c2-400c-b14f-7bbcadd35baf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:03.440648 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8863ca3-a0c2-400c-b14f-7bbcadd35baf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:03.441202 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8863ca3-a0c2-400c-b14f-7bbcadd35baf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:03.441875 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8863ca3-a0c2-400c-b14f-7bbcadd35baf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:03.442290 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8863ca3-a0c2-400c-b14f-7bbcadd35baf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:03.442713 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8863ca3-a0c2-400c-b14f-7bbcadd35baf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:03.580754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e8863ca3-a0c2-400c-b14f-7bbcadd35baf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:03.590757 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e8863ca3-a0c2-400c-b14f-7bbcadd35baf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.161741 Sep 27 16:43:03.591351 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 397/845] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:03 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:03.595979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bfe0128d-17b5-4bb2-85b8-044d034e14f0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:03.598566 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bfe0128d-17b5-4bb2-85b8-044d034e14f0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:03.604715 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfe0128d-17b5-4bb2-85b8-044d034e14f0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:03.605193 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfe0128d-17b5-4bb2-85b8-044d034e14f0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:03.605812 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfe0128d-17b5-4bb2-85b8-044d034e14f0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:03.606504 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfe0128d-17b5-4bb2-85b8-044d034e14f0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:03.607002 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfe0128d-17b5-4bb2-85b8-044d034e14f0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:03.607419 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfe0128d-17b5-4bb2-85b8-044d034e14f0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:03.764810 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bfe0128d-17b5-4bb2-85b8-044d034e14f0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:03.774312 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bfe0128d-17b5-4bb2-85b8-044d034e14f0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:03.775785 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bfe0128d-17b5-4bb2-85b8-044d034e14f0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:03.776939 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bfe0128d-17b5-4bb2-85b8-044d034e14f0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1731 microversion: 2.20 time: 0.184690 Sep 27 16:43:03.777536 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 398/846] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:43:03 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:43:03.843925 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-00aa5f9c-450e-4ada-95cb-a969d66bb7fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.148980 Sep 27 16:43:03.844711 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 449/847] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Sep 27 16:43:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 16:43:03.856684 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-30294473-84ae-4602-bb53-797baddabca4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:03.857386 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-30294473-84ae-4602-bb53-797baddabca4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:03.926174 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-30294473-84ae-4602-bb53-797baddabca4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:03.930505 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-30294473-84ae-4602-bb53-797baddabca4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1089 microversion: 2.1 time: 0.077922 Sep 27 16:43:03.931049 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 399/848] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:03 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1089 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:43:04.616403 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e90a5a29-2584-4a05-977f-ec7d25b34beb tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:04.617018 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e90a5a29-2584-4a05-977f-ec7d25b34beb tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:04.623709 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e90a5a29-2584-4a05-977f-ec7d25b34beb tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:04.624283 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e90a5a29-2584-4a05-977f-ec7d25b34beb tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:04.624749 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e90a5a29-2584-4a05-977f-ec7d25b34beb tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:04.625480 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e90a5a29-2584-4a05-977f-ec7d25b34beb tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:04.625942 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e90a5a29-2584-4a05-977f-ec7d25b34beb tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:04.626427 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e90a5a29-2584-4a05-977f-ec7d25b34beb tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:04.761292 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e90a5a29-2584-4a05-977f-ec7d25b34beb tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:04.769959 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e90a5a29-2584-4a05-977f-ec7d25b34beb tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.158146 Sep 27 16:43:04.770531 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 450/849] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:04 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:04.804241 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-92e6d44d-0fc3-4fbd-890f-f9b6a81490d9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:04.804928 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-92e6d44d-0fc3-4fbd-890f-f9b6a81490d9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:04.811914 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-92e6d44d-0fc3-4fbd-890f-f9b6a81490d9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:04.812511 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-92e6d44d-0fc3-4fbd-890f-f9b6a81490d9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:04.812986 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-92e6d44d-0fc3-4fbd-890f-f9b6a81490d9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:04.813803 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-92e6d44d-0fc3-4fbd-890f-f9b6a81490d9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:04.814280 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-92e6d44d-0fc3-4fbd-890f-f9b6a81490d9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:04.814686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-92e6d44d-0fc3-4fbd-890f-f9b6a81490d9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:04.954479 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-92e6d44d-0fc3-4fbd-890f-f9b6a81490d9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:04.954881 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6eee06c4-b41b-463e-bc44-e397cbd51562 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:04.955499 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6eee06c4-b41b-463e-bc44-e397cbd51562 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:04.964826 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-92e6d44d-0fc3-4fbd-890f-f9b6a81490d9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:04.966337 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-92e6d44d-0fc3-4fbd-890f-f9b6a81490d9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:04.967758 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-92e6d44d-0fc3-4fbd-890f-f9b6a81490d9 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1731 microversion: 2.20 time: 0.168739 Sep 27 16:43:04.968386 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 400/850] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:43:04 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:43:05.010878 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6eee06c4-b41b-463e-bc44-e397cbd51562 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:05.018172 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6eee06c4-b41b-463e-bc44-e397cbd51562 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1089 microversion: 2.1 time: 0.068596 Sep 27 16:43:05.019575 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 451/851] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:04 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:43:05.793492 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0701f815-a97f-49a6-aaf0-cdbf36987612 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:05.794096 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0701f815-a97f-49a6-aaf0-cdbf36987612 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:05.800048 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0701f815-a97f-49a6-aaf0-cdbf36987612 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:05.801011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0701f815-a97f-49a6-aaf0-cdbf36987612 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:05.801438 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0701f815-a97f-49a6-aaf0-cdbf36987612 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:05.802124 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0701f815-a97f-49a6-aaf0-cdbf36987612 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:05.802570 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0701f815-a97f-49a6-aaf0-cdbf36987612 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:05.803040 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0701f815-a97f-49a6-aaf0-cdbf36987612 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:05.937546 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0701f815-a97f-49a6-aaf0-cdbf36987612 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:05.946357 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0701f815-a97f-49a6-aaf0-cdbf36987612 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.156671 Sep 27 16:43:05.947001 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 401/852] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:05 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:43:05.998453 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-aaff6e79-47e0-4156-ad8a-fef93c44f9ee tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:05.999095 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-aaff6e79-47e0-4156-ad8a-fef93c44f9ee tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:06.005229 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aaff6e79-47e0-4156-ad8a-fef93c44f9ee tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:06.005723 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aaff6e79-47e0-4156-ad8a-fef93c44f9ee tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:06.006187 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aaff6e79-47e0-4156-ad8a-fef93c44f9ee tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:06.006906 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aaff6e79-47e0-4156-ad8a-fef93c44f9ee tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:06.007363 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aaff6e79-47e0-4156-ad8a-fef93c44f9ee tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:06.007789 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aaff6e79-47e0-4156-ad8a-fef93c44f9ee tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:06.041952 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-52d51b90-0d22-4b7f-8ffc-23787c64e3a4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:06.042845 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-52d51b90-0d22-4b7f-8ffc-23787c64e3a4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:06.048960 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-52d51b90-0d22-4b7f-8ffc-23787c64e3a4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:06.049440 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-52d51b90-0d22-4b7f-8ffc-23787c64e3a4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:06.051216 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-52d51b90-0d22-4b7f-8ffc-23787c64e3a4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:06.051921 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-52d51b90-0d22-4b7f-8ffc-23787c64e3a4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:06.052545 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-52d51b90-0d22-4b7f-8ffc-23787c64e3a4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:06.053019 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-52d51b90-0d22-4b7f-8ffc-23787c64e3a4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:06.140263 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-52d51b90-0d22-4b7f-8ffc-23787c64e3a4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:06.148382 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-52d51b90-0d22-4b7f-8ffc-23787c64e3a4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1139 microversion: 2.1 time: 0.110470 Sep 27 16:43:06.149132 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 402/853] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:06 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1139 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:06.171575 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-aaff6e79-47e0-4156-ad8a-fef93c44f9ee tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:06.180377 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-aaff6e79-47e0-4156-ad8a-fef93c44f9ee tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:06.181833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-aaff6e79-47e0-4156-ad8a-fef93c44f9ee tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:06.183004 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-aaff6e79-47e0-4156-ad8a-fef93c44f9ee tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1731 microversion: 2.20 time: 0.192662 Sep 27 16:43:06.183551 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 452/854] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:43:05 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:43:06.969042 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b88d0d22-3e28-4fdd-96bf-326c4033ab06 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:06.969657 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b88d0d22-3e28-4fdd-96bf-326c4033ab06 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:06.978243 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b88d0d22-3e28-4fdd-96bf-326c4033ab06 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:06.978948 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b88d0d22-3e28-4fdd-96bf-326c4033ab06 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:06.979435 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b88d0d22-3e28-4fdd-96bf-326c4033ab06 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:06.980347 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b88d0d22-3e28-4fdd-96bf-326c4033ab06 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:06.980954 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b88d0d22-3e28-4fdd-96bf-326c4033ab06 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:06.981583 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b88d0d22-3e28-4fdd-96bf-326c4033ab06 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:07.125604 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b88d0d22-3e28-4fdd-96bf-326c4033ab06 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:07.133912 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b88d0d22-3e28-4fdd-96bf-326c4033ab06 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.169005 Sep 27 16:43:07.134812 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 403/855] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:06 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:07.150204 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-5bad5d05-c7f6-4455-bf06-db218a008980 req-f973e80d-c3a9-4e29-a06b-753ebf58fdae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac", "name": "network-vif-plugged", "status": "completed", "tag": "ddb6a707-22f0-4c10-adcc-9f4d5d262645"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:43:07.160561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-5bad5d05-c7f6-4455-bf06-db218a008980 req-f973e80d-c3a9-4e29-a06b-753ebf58fdae service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:07.161138 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-5bad5d05-c7f6-4455-bf06-db218a008980 req-f973e80d-c3a9-4e29-a06b-753ebf58fdae service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:07.161570 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-5bad5d05-c7f6-4455-bf06-db218a008980 req-f973e80d-c3a9-4e29-a06b-753ebf58fdae service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:07.172812 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-5bad5d05-c7f6-4455-bf06-db218a008980 req-f973e80d-c3a9-4e29-a06b-753ebf58fdae service nova] Creating event network-vif-plugged:ddb6a707-22f0-4c10-adcc-9f4d5d262645 for instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac on hv-cinder-85506 Sep 27 16:43:07.173823 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3ec63570-a195-4b0a-9e1c-d165e42946e2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:07.176885 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3ec63570-a195-4b0a-9e1c-d165e42946e2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:07.178240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-5bad5d05-c7f6-4455-bf06-db218a008980 req-f973e80d-c3a9-4e29-a06b-753ebf58fdae service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031782 Sep 27 16:43:07.179076 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 453/856] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:43:07.183752 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ec63570-a195-4b0a-9e1c-d165e42946e2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:07.184320 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ec63570-a195-4b0a-9e1c-d165e42946e2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:07.184821 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ec63570-a195-4b0a-9e1c-d165e42946e2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:07.185587 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ec63570-a195-4b0a-9e1c-d165e42946e2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:07.186105 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ec63570-a195-4b0a-9e1c-d165e42946e2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:07.186593 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ec63570-a195-4b0a-9e1c-d165e42946e2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:07.209173 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c3209c2c-2944-42b4-a531-dc3ce8b6b765 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:07.211073 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c3209c2c-2944-42b4-a531-dc3ce8b6b765 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:07.218241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c3209c2c-2944-42b4-a531-dc3ce8b6b765 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:07.218841 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c3209c2c-2944-42b4-a531-dc3ce8b6b765 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:07.219353 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c3209c2c-2944-42b4-a531-dc3ce8b6b765 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:07.220127 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c3209c2c-2944-42b4-a531-dc3ce8b6b765 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:07.220679 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c3209c2c-2944-42b4-a531-dc3ce8b6b765 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:07.221332 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c3209c2c-2944-42b4-a531-dc3ce8b6b765 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:07.258901 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3ec63570-a195-4b0a-9e1c-d165e42946e2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:07.267423 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3ec63570-a195-4b0a-9e1c-d165e42946e2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1187 microversion: 2.1 time: 0.098354 Sep 27 16:43:07.267998 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 404/857] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:07 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1187 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:07.358711 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c3209c2c-2944-42b4-a531-dc3ce8b6b765 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:07.368637 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c3209c2c-2944-42b4-a531-dc3ce8b6b765 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:07.370163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c3209c2c-2944-42b4-a531-dc3ce8b6b765 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:07.371373 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c3209c2c-2944-42b4-a531-dc3ce8b6b765 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1731 microversion: 2.20 time: 0.167070 Sep 27 16:43:07.371928 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 454/858] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:43:07 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:43:08.158658 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c4d8e228-6c16-4bd7-9f99-a5bf4fab4c2f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:08.161184 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c4d8e228-6c16-4bd7-9f99-a5bf4fab4c2f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:08.169661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4d8e228-6c16-4bd7-9f99-a5bf4fab4c2f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:08.170452 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4d8e228-6c16-4bd7-9f99-a5bf4fab4c2f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:08.171007 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4d8e228-6c16-4bd7-9f99-a5bf4fab4c2f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:08.171901 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4d8e228-6c16-4bd7-9f99-a5bf4fab4c2f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:08.172361 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4d8e228-6c16-4bd7-9f99-a5bf4fab4c2f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:08.172787 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4d8e228-6c16-4bd7-9f99-a5bf4fab4c2f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:08.293350 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-44ad407a-89e2-495c-ad3b-81b17a3dd84d tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:08.295044 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-44ad407a-89e2-495c-ad3b-81b17a3dd84d tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:08.300776 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-44ad407a-89e2-495c-ad3b-81b17a3dd84d tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:08.301274 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-44ad407a-89e2-495c-ad3b-81b17a3dd84d tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:08.301712 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-44ad407a-89e2-495c-ad3b-81b17a3dd84d tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:08.302451 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-44ad407a-89e2-495c-ad3b-81b17a3dd84d tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:08.302963 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-44ad407a-89e2-495c-ad3b-81b17a3dd84d tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:08.303369 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-44ad407a-89e2-495c-ad3b-81b17a3dd84d tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:08.335197 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c4d8e228-6c16-4bd7-9f99-a5bf4fab4c2f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:08.343134 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c4d8e228-6c16-4bd7-9f99-a5bf4fab4c2f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.189586 Sep 27 16:43:08.344478 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 405/859] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:08 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:08.387146 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-44ad407a-89e2-495c-ad3b-81b17a3dd84d tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:08.394180 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-44ad407a-89e2-495c-ad3b-81b17a3dd84d tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1187 microversion: 2.1 time: 0.104984 Sep 27 16:43:08.395625 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 455/860] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:08 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1187 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:08.399283 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1b4d9f78-5db9-485b-8734-d0932b7b6dba tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:08.399944 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1b4d9f78-5db9-485b-8734-d0932b7b6dba tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:08.407675 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b4d9f78-5db9-485b-8734-d0932b7b6dba tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:08.408789 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b4d9f78-5db9-485b-8734-d0932b7b6dba tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:08.409277 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b4d9f78-5db9-485b-8734-d0932b7b6dba tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:08.410424 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b4d9f78-5db9-485b-8734-d0932b7b6dba tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:08.411001 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b4d9f78-5db9-485b-8734-d0932b7b6dba tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:08.411656 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b4d9f78-5db9-485b-8734-d0932b7b6dba tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:08.560278 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1b4d9f78-5db9-485b-8734-d0932b7b6dba tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:08.564988 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:08.573710 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1b4d9f78-5db9-485b-8734-d0932b7b6dba tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:08.575204 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1b4d9f78-5db9-485b-8734-d0932b7b6dba tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:08.576377 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1b4d9f78-5db9-485b-8734-d0932b7b6dba tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1731 microversion: 2.20 time: 0.182652 Sep 27 16:43:08.576932 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 406/861] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:43:08 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 16:43:09.365551 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9d9e3495-683b-4703-9f7a-0c8fa7b2e443 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:09.366245 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9d9e3495-683b-4703-9f7a-0c8fa7b2e443 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:09.372613 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d9e3495-683b-4703-9f7a-0c8fa7b2e443 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:09.373103 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d9e3495-683b-4703-9f7a-0c8fa7b2e443 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:09.373594 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d9e3495-683b-4703-9f7a-0c8fa7b2e443 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:09.374658 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d9e3495-683b-4703-9f7a-0c8fa7b2e443 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:09.375154 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d9e3495-683b-4703-9f7a-0c8fa7b2e443 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:09.375706 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d9e3495-683b-4703-9f7a-0c8fa7b2e443 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:09.417913 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-aa6ce869-0a9d-4969-99a1-0d246a395f80 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:09.418514 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-aa6ce869-0a9d-4969-99a1-0d246a395f80 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:09.428781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa6ce869-0a9d-4969-99a1-0d246a395f80 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:09.429278 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa6ce869-0a9d-4969-99a1-0d246a395f80 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:09.429714 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa6ce869-0a9d-4969-99a1-0d246a395f80 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:09.430472 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa6ce869-0a9d-4969-99a1-0d246a395f80 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:09.430986 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa6ce869-0a9d-4969-99a1-0d246a395f80 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:09.431412 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa6ce869-0a9d-4969-99a1-0d246a395f80 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:09.516128 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-aa6ce869-0a9d-4969-99a1-0d246a395f80 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:09.525082 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-aa6ce869-0a9d-4969-99a1-0d246a395f80 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1205 microversion: 2.1 time: 0.111021 Sep 27 16:43:09.525660 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 407/862] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:09 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1205 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:09.556706 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9d9e3495-683b-4703-9f7a-0c8fa7b2e443 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:09.564518 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9d9e3495-683b-4703-9f7a-0c8fa7b2e443 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.202869 Sep 27 16:43:09.565125 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 456/863] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:09 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:09.604006 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f0e67f79-9a35-4b3f-84bb-1d821ae4c26f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:09.604600 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f0e67f79-9a35-4b3f-84bb-1d821ae4c26f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:09.610826 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f0e67f79-9a35-4b3f-84bb-1d821ae4c26f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:09.611307 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f0e67f79-9a35-4b3f-84bb-1d821ae4c26f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:09.615353 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f0e67f79-9a35-4b3f-84bb-1d821ae4c26f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:09.615353 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f0e67f79-9a35-4b3f-84bb-1d821ae4c26f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:09.615353 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f0e67f79-9a35-4b3f-84bb-1d821ae4c26f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:09.615353 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f0e67f79-9a35-4b3f-84bb-1d821ae4c26f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:09.755866 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f0e67f79-9a35-4b3f-84bb-1d821ae4c26f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:09.768395 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f0e67f79-9a35-4b3f-84bb-1d821ae4c26f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:09.770701 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f0e67f79-9a35-4b3f-84bb-1d821ae4c26f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:09.771865 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f0e67f79-9a35-4b3f-84bb-1d821ae4c26f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1731 microversion: 2.20 time: 0.172045 Sep 27 16:43:09.772428 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 408/864] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:43:09 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:43:10.550763 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6d1ca883-dcfc-49ef-b6b3-d2697390e428 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:10.551479 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6d1ca883-dcfc-49ef-b6b3-d2697390e428 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:10.557501 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6d1ca883-dcfc-49ef-b6b3-d2697390e428 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:10.557982 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6d1ca883-dcfc-49ef-b6b3-d2697390e428 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:10.558413 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6d1ca883-dcfc-49ef-b6b3-d2697390e428 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:10.560747 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6d1ca883-dcfc-49ef-b6b3-d2697390e428 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:10.560747 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6d1ca883-dcfc-49ef-b6b3-d2697390e428 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:10.560747 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6d1ca883-dcfc-49ef-b6b3-d2697390e428 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:10.590265 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d7f3588a-5f4a-4fa9-b2bc-6bfc01dbafea tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:10.591108 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d7f3588a-5f4a-4fa9-b2bc-6bfc01dbafea tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:10.598655 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7f3588a-5f4a-4fa9-b2bc-6bfc01dbafea tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:10.599261 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7f3588a-5f4a-4fa9-b2bc-6bfc01dbafea tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:10.599671 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7f3588a-5f4a-4fa9-b2bc-6bfc01dbafea tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:10.600557 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7f3588a-5f4a-4fa9-b2bc-6bfc01dbafea tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:10.601311 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7f3588a-5f4a-4fa9-b2bc-6bfc01dbafea tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:10.602071 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7f3588a-5f4a-4fa9-b2bc-6bfc01dbafea tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:10.778726 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6d1ca883-dcfc-49ef-b6b3-d2697390e428 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:10.791640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6d1ca883-dcfc-49ef-b6b3-d2697390e428 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1273 microversion: 2.1 time: 0.244779 Sep 27 16:43:10.792559 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 457/865] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:10 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1273 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:10.797855 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8d9c09ad-1f72-449b-bfc6-c97dcf84f2ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:10.798733 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8d9c09ad-1f72-449b-bfc6-c97dcf84f2ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:10.805961 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d9c09ad-1f72-449b-bfc6-c97dcf84f2ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:10.806587 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d9c09ad-1f72-449b-bfc6-c97dcf84f2ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:10.807286 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d9c09ad-1f72-449b-bfc6-c97dcf84f2ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:10.808218 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d9c09ad-1f72-449b-bfc6-c97dcf84f2ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:10.809029 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d9c09ad-1f72-449b-bfc6-c97dcf84f2ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:10.809544 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d9c09ad-1f72-449b-bfc6-c97dcf84f2ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:10.819276 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d7f3588a-5f4a-4fa9-b2bc-6bfc01dbafea tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:10.827811 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d7f3588a-5f4a-4fa9-b2bc-6bfc01dbafea tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.244071 Sep 27 16:43:10.828736 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 409/866] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:10 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:10.961374 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8d9c09ad-1f72-449b-bfc6-c97dcf84f2ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:10.969818 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8d9c09ad-1f72-449b-bfc6-c97dcf84f2ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:10.971297 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8d9c09ad-1f72-449b-bfc6-c97dcf84f2ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:10.973175 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8d9c09ad-1f72-449b-bfc6-c97dcf84f2ff tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1731 microversion: 2.20 time: 0.178728 Sep 27 16:43:10.978046 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 458/867] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:43:10 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:43:11.086891 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-a6f0a4b4-a676-477c-b37a-5d85c3cff934 req-1297a927-d52d-49a8-9b48-bff177f99d49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800233b1-cc79-4eb5-9cdf-ff21e8321268", "tag": "c6777043-34a8-4a48-b945-7f80df4e0022"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:43:11.096481 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a6f0a4b4-a676-477c-b37a-5d85c3cff934 req-1297a927-d52d-49a8-9b48-bff177f99d49 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:11.104425 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a6f0a4b4-a676-477c-b37a-5d85c3cff934 req-1297a927-d52d-49a8-9b48-bff177f99d49 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:11.104425 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a6f0a4b4-a676-477c-b37a-5d85c3cff934 req-1297a927-d52d-49a8-9b48-bff177f99d49 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:11.109783 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-a6f0a4b4-a676-477c-b37a-5d85c3cff934 req-1297a927-d52d-49a8-9b48-bff177f99d49 service nova] Creating event network-changed:c6777043-34a8-4a48-b945-7f80df4e0022 for instance 800233b1-cc79-4eb5-9cdf-ff21e8321268 on hv-cinder-85506 Sep 27 16:43:11.115041 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-a6f0a4b4-a676-477c-b37a-5d85c3cff934 req-1297a927-d52d-49a8-9b48-bff177f99d49 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032663 Sep 27 16:43:11.115636 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 410/868] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:43:11.817482 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0c5cc37b-3174-4dcd-8731-3fd8d4680fc3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:11.818092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0c5cc37b-3174-4dcd-8731-3fd8d4680fc3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:11.823984 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c5cc37b-3174-4dcd-8731-3fd8d4680fc3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:11.824463 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c5cc37b-3174-4dcd-8731-3fd8d4680fc3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:11.824896 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c5cc37b-3174-4dcd-8731-3fd8d4680fc3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:11.825576 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c5cc37b-3174-4dcd-8731-3fd8d4680fc3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:11.826026 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c5cc37b-3174-4dcd-8731-3fd8d4680fc3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:11.826444 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c5cc37b-3174-4dcd-8731-3fd8d4680fc3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:11.853328 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f2976aa9-1bed-409f-b503-52e8027a1e11 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:11.854201 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f2976aa9-1bed-409f-b503-52e8027a1e11 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:11.860574 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2976aa9-1bed-409f-b503-52e8027a1e11 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:11.861131 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2976aa9-1bed-409f-b503-52e8027a1e11 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:11.861670 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2976aa9-1bed-409f-b503-52e8027a1e11 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:11.862409 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2976aa9-1bed-409f-b503-52e8027a1e11 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:11.863480 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2976aa9-1bed-409f-b503-52e8027a1e11 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:11.863990 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2976aa9-1bed-409f-b503-52e8027a1e11 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:12.015191 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0c5cc37b-3174-4dcd-8731-3fd8d4680fc3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:12.027082 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0c5cc37b-3174-4dcd-8731-3fd8d4680fc3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1273 microversion: 2.1 time: 0.214111 Sep 27 16:43:12.027662 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 459/869] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:11 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1273 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:12.035965 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-044fcd3e-dd3e-4344-b0dd-c0a6215eb558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:12.035965 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-044fcd3e-dd3e-4344-b0dd-c0a6215eb558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:12.042463 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-044fcd3e-dd3e-4344-b0dd-c0a6215eb558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:12.042996 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-044fcd3e-dd3e-4344-b0dd-c0a6215eb558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:12.043438 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-044fcd3e-dd3e-4344-b0dd-c0a6215eb558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:12.044133 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-044fcd3e-dd3e-4344-b0dd-c0a6215eb558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:12.044782 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-044fcd3e-dd3e-4344-b0dd-c0a6215eb558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:12.045189 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-044fcd3e-dd3e-4344-b0dd-c0a6215eb558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:12.059609 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f2976aa9-1bed-409f-b503-52e8027a1e11 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:12.069005 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f2976aa9-1bed-409f-b503-52e8027a1e11 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.220420 Sep 27 16:43:12.079580 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 411/870] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:11 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:43:12.194028 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-044fcd3e-dd3e-4344-b0dd-c0a6215eb558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:12.202071 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-044fcd3e-dd3e-4344-b0dd-c0a6215eb558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:12.203605 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-044fcd3e-dd3e-4344-b0dd-c0a6215eb558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:12.204748 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-044fcd3e-dd3e-4344-b0dd-c0a6215eb558 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1718 microversion: 2.20 time: 0.174345 Sep 27 16:43:12.205294 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 460/871] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:43:12 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1718 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:43:12.212433 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-16d98acd-fe28-4398-b4b9-b8100aa6bb14 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:12.212964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-16d98acd-fe28-4398-b4b9-b8100aa6bb14 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:12.219025 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-16d98acd-fe28-4398-b4b9-b8100aa6bb14 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:12.219510 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-16d98acd-fe28-4398-b4b9-b8100aa6bb14 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:12.219946 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-16d98acd-fe28-4398-b4b9-b8100aa6bb14 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:12.220637 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-16d98acd-fe28-4398-b4b9-b8100aa6bb14 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:12.221091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-16d98acd-fe28-4398-b4b9-b8100aa6bb14 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:12.221518 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-16d98acd-fe28-4398-b4b9-b8100aa6bb14 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:12.307518 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-16d98acd-fe28-4398-b4b9-b8100aa6bb14 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lazy-loading 'services' on Instance uuid 742a4313-504c-4882-8811-aafcac933bf4 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:43:12.523467 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-16d98acd-fe28-4398-b4b9-b8100aa6bb14 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "DELETE /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4/os-volume_attachments/586298d7-4fdc-4c33-8364-767825cea741" status: 202 len: 0 microversion: 2.1 time: 0.314764 Sep 27 16:43:12.523986 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 412/872] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Sep 27 16:43:12 2022] DELETE /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4/os-volume_attachments/586298d7-4fdc-4c33-8364-767825cea741 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:43:12.532621 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-16d541ea-0f59-4199-8118-bbe1a41c071a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:12.535624 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-16d541ea-0f59-4199-8118-bbe1a41c071a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:12.541519 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-16d541ea-0f59-4199-8118-bbe1a41c071a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:12.542030 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-16d541ea-0f59-4199-8118-bbe1a41c071a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:12.542487 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-16d541ea-0f59-4199-8118-bbe1a41c071a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:12.543228 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-16d541ea-0f59-4199-8118-bbe1a41c071a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:12.543817 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-16d541ea-0f59-4199-8118-bbe1a41c071a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:12.544246 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-16d541ea-0f59-4199-8118-bbe1a41c071a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:12.578739 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-16d541ea-0f59-4199-8118-bbe1a41c071a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047594 Sep 27 16:43:12.579332 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 461/873] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Sep 27 16:43:12 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:43:13.059997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-367f1ac4-8f48-43af-8aef-82181f9857c4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:13.060700 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-367f1ac4-8f48-43af-8aef-82181f9857c4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:13.067520 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-367f1ac4-8f48-43af-8aef-82181f9857c4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:13.068005 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-367f1ac4-8f48-43af-8aef-82181f9857c4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:13.068440 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-367f1ac4-8f48-43af-8aef-82181f9857c4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:13.069136 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-367f1ac4-8f48-43af-8aef-82181f9857c4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:13.069592 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-367f1ac4-8f48-43af-8aef-82181f9857c4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:13.070016 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-367f1ac4-8f48-43af-8aef-82181f9857c4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:13.092981 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-079f6737-e90c-4893-a792-22543e3af2cf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:13.093595 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-079f6737-e90c-4893-a792-22543e3af2cf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:13.099991 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-079f6737-e90c-4893-a792-22543e3af2cf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:13.100480 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-079f6737-e90c-4893-a792-22543e3af2cf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:13.100946 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-079f6737-e90c-4893-a792-22543e3af2cf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:13.101640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-079f6737-e90c-4893-a792-22543e3af2cf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:13.102720 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-079f6737-e90c-4893-a792-22543e3af2cf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:13.103173 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-079f6737-e90c-4893-a792-22543e3af2cf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:13.248706 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:13.256048 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-367f1ac4-8f48-43af-8aef-82181f9857c4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:13.263800 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-367f1ac4-8f48-43af-8aef-82181f9857c4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1273 microversion: 2.1 time: 0.208705 Sep 27 16:43:13.264400 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 413/874] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:13 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1273 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:13.280159 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-079f6737-e90c-4893-a792-22543e3af2cf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:13.287999 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-079f6737-e90c-4893-a792-22543e3af2cf tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.199015 Sep 27 16:43:13.288573 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 462/875] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:13 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:43:13.594964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-03ef6c56-4d43-4833-9568-cb1129daec01 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:13.597177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-03ef6c56-4d43-4833-9568-cb1129daec01 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:13.603905 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03ef6c56-4d43-4833-9568-cb1129daec01 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:13.604386 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03ef6c56-4d43-4833-9568-cb1129daec01 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:13.604822 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03ef6c56-4d43-4833-9568-cb1129daec01 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:13.605538 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03ef6c56-4d43-4833-9568-cb1129daec01 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:13.605990 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03ef6c56-4d43-4833-9568-cb1129daec01 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:13.606410 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03ef6c56-4d43-4833-9568-cb1129daec01 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:13.637249 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-03ef6c56-4d43-4833-9568-cb1129daec01 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046341 Sep 27 16:43:13.637795 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 414/876] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Sep 27 16:43:13 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:43:14.288105 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8f65b155-6758-4670-877d-8c0c588cde02 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:14.289540 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8f65b155-6758-4670-877d-8c0c588cde02 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:14.295665 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f65b155-6758-4670-877d-8c0c588cde02 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:14.296159 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f65b155-6758-4670-877d-8c0c588cde02 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:14.298183 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f65b155-6758-4670-877d-8c0c588cde02 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:14.298183 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f65b155-6758-4670-877d-8c0c588cde02 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:14.298183 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f65b155-6758-4670-877d-8c0c588cde02 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:14.298183 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f65b155-6758-4670-877d-8c0c588cde02 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:14.312293 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c8b84267-44a7-431b-bec4-8f5a1c428e35 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:14.314634 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c8b84267-44a7-431b-bec4-8f5a1c428e35 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:14.325911 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:14.327295 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c8b84267-44a7-431b-bec4-8f5a1c428e35 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:14.327982 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c8b84267-44a7-431b-bec4-8f5a1c428e35 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:14.328568 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c8b84267-44a7-431b-bec4-8f5a1c428e35 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:14.329401 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c8b84267-44a7-431b-bec4-8f5a1c428e35 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:14.330010 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c8b84267-44a7-431b-bec4-8f5a1c428e35 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:14.330584 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c8b84267-44a7-431b-bec4-8f5a1c428e35 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:14.523980 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8f65b155-6758-4670-877d-8c0c588cde02 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:14.535344 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8f65b155-6758-4670-877d-8c0c588cde02 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1273 microversion: 2.1 time: 0.251824 Sep 27 16:43:14.536166 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 463/877] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:14 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1273 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:14.551272 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c8b84267-44a7-431b-bec4-8f5a1c428e35 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:14.559519 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c8b84267-44a7-431b-bec4-8f5a1c428e35 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.252315 Sep 27 16:43:14.560089 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 415/878] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:14 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:43:14.649935 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-10e77a37-4151-4fd5-a067-9465a2c36cc3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:14.652230 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-10e77a37-4151-4fd5-a067-9465a2c36cc3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:14.658685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10e77a37-4151-4fd5-a067-9465a2c36cc3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:14.659207 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10e77a37-4151-4fd5-a067-9465a2c36cc3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:14.659961 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10e77a37-4151-4fd5-a067-9465a2c36cc3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:14.660858 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10e77a37-4151-4fd5-a067-9465a2c36cc3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:14.661323 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10e77a37-4151-4fd5-a067-9465a2c36cc3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:14.661778 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10e77a37-4151-4fd5-a067-9465a2c36cc3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:14.689047 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:14.693851 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-10e77a37-4151-4fd5-a067-9465a2c36cc3 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047966 Sep 27 16:43:14.694411 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 464/879] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Sep 27 16:43:14 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:43:15.558222 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-77054ed3-f395-4899-a78f-3e3600fd741a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:15.558861 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-77054ed3-f395-4899-a78f-3e3600fd741a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:15.565292 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77054ed3-f395-4899-a78f-3e3600fd741a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:15.565783 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77054ed3-f395-4899-a78f-3e3600fd741a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:15.566334 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77054ed3-f395-4899-a78f-3e3600fd741a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:15.567068 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77054ed3-f395-4899-a78f-3e3600fd741a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:15.567522 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77054ed3-f395-4899-a78f-3e3600fd741a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:15.567948 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77054ed3-f395-4899-a78f-3e3600fd741a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:15.585022 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bb0dfaf6-2a1b-4ccb-8c22-4991db5b428c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:15.586289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bb0dfaf6-2a1b-4ccb-8c22-4991db5b428c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:15.588205 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=8 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:15.593317 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb0dfaf6-2a1b-4ccb-8c22-4991db5b428c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:15.593792 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb0dfaf6-2a1b-4ccb-8c22-4991db5b428c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:15.600656 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb0dfaf6-2a1b-4ccb-8c22-4991db5b428c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:15.600656 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb0dfaf6-2a1b-4ccb-8c22-4991db5b428c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:15.600656 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb0dfaf6-2a1b-4ccb-8c22-4991db5b428c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:15.600656 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb0dfaf6-2a1b-4ccb-8c22-4991db5b428c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:15.762871 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-77054ed3-f395-4899-a78f-3e3600fd741a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:15.772147 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-77054ed3-f395-4899-a78f-3e3600fd741a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1273 microversion: 2.1 time: 0.217701 Sep 27 16:43:15.773177 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 416/880] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:15 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1273 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:15.777380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4b5d13ce-6929-470e-ae43-934d0767286c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:15.779863 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4b5d13ce-6929-470e-ae43-934d0767286c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:15.786260 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b5d13ce-6929-470e-ae43-934d0767286c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:15.786749 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b5d13ce-6929-470e-ae43-934d0767286c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:15.787219 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b5d13ce-6929-470e-ae43-934d0767286c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:15.787930 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b5d13ce-6929-470e-ae43-934d0767286c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:15.788376 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b5d13ce-6929-470e-ae43-934d0767286c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:15.788794 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b5d13ce-6929-470e-ae43-934d0767286c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:15.798450 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bb0dfaf6-2a1b-4ccb-8c22-4991db5b428c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:15.807019 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bb0dfaf6-2a1b-4ccb-8c22-4991db5b428c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.228198 Sep 27 16:43:15.808182 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 465/881] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:15 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:15.822794 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4b5d13ce-6929-470e-ae43-934d0767286c tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048914 Sep 27 16:43:15.823354 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 417/882] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Sep 27 16:43:15 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:43:16.246019 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-bbe05630-e97d-419e-9696-2454b5fa17e7 req-35d6bfc4-a06a-4870-b9c2-e1b78c5b0780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50687ace-d869-4712-9cf7-0d16c7244ac7", "name": "network-vif-plugged", "status": "completed", "tag": "bfce7c0e-1dc8-42b2-b518-7b30f07592fc"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:43:16.252671 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:16.257237 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-bbe05630-e97d-419e-9696-2454b5fa17e7 req-35d6bfc4-a06a-4870-b9c2-e1b78c5b0780 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:16.257723 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-bbe05630-e97d-419e-9696-2454b5fa17e7 req-35d6bfc4-a06a-4870-b9c2-e1b78c5b0780 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:16.258153 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-bbe05630-e97d-419e-9696-2454b5fa17e7 req-35d6bfc4-a06a-4870-b9c2-e1b78c5b0780 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:16.270149 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-bbe05630-e97d-419e-9696-2454b5fa17e7 req-35d6bfc4-a06a-4870-b9c2-e1b78c5b0780 service nova] Creating event network-vif-plugged:bfce7c0e-1dc8-42b2-b518-7b30f07592fc for instance 50687ace-d869-4712-9cf7-0d16c7244ac7 on hv-cinder-85506 Sep 27 16:43:16.275289 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-bbe05630-e97d-419e-9696-2454b5fa17e7 req-35d6bfc4-a06a-4870-b9c2-e1b78c5b0780 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033875 Sep 27 16:43:16.276093 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 466/883] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:43:16.795875 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-22275b19-3ed3-401d-9e6c-bef53298f5c0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:16.796480 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-22275b19-3ed3-401d-9e6c-bef53298f5c0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:16.803715 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-22275b19-3ed3-401d-9e6c-bef53298f5c0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:16.804195 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-22275b19-3ed3-401d-9e6c-bef53298f5c0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:16.804623 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-22275b19-3ed3-401d-9e6c-bef53298f5c0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:16.805302 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-22275b19-3ed3-401d-9e6c-bef53298f5c0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:16.805748 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-22275b19-3ed3-401d-9e6c-bef53298f5c0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:16.806164 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-22275b19-3ed3-401d-9e6c-bef53298f5c0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:16.832508 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0f3a0f58-b8b0-4a32-bf8f-fd2efecd5f9e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:16.833224 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0f3a0f58-b8b0-4a32-bf8f-fd2efecd5f9e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:16.840636 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f3a0f58-b8b0-4a32-bf8f-fd2efecd5f9e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:16.841127 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f3a0f58-b8b0-4a32-bf8f-fd2efecd5f9e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:16.841560 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f3a0f58-b8b0-4a32-bf8f-fd2efecd5f9e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:16.842255 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f3a0f58-b8b0-4a32-bf8f-fd2efecd5f9e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:16.842790 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f3a0f58-b8b0-4a32-bf8f-fd2efecd5f9e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:16.843327 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f3a0f58-b8b0-4a32-bf8f-fd2efecd5f9e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:16.983188 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-22275b19-3ed3-401d-9e6c-bef53298f5c0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:16.992352 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-22275b19-3ed3-401d-9e6c-bef53298f5c0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1261 microversion: 2.1 time: 0.200370 Sep 27 16:43:17.012918 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 418/884] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:16 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1261 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:17.018100 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ac599a50-b5b6-4d8d-bed0-6feebdb9e11d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:17.020964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ac599a50-b5b6-4d8d-bed0-6feebdb9e11d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:17.021098 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0f3a0f58-b8b0-4a32-bf8f-fd2efecd5f9e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:17.028401 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac599a50-b5b6-4d8d-bed0-6feebdb9e11d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:17.028889 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac599a50-b5b6-4d8d-bed0-6feebdb9e11d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:17.029038 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0f3a0f58-b8b0-4a32-bf8f-fd2efecd5f9e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.201835 Sep 27 16:43:17.029574 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac599a50-b5b6-4d8d-bed0-6feebdb9e11d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:17.029856 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 467/885] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:16 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:43:17.030277 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac599a50-b5b6-4d8d-bed0-6feebdb9e11d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:17.030754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac599a50-b5b6-4d8d-bed0-6feebdb9e11d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:17.031204 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac599a50-b5b6-4d8d-bed0-6feebdb9e11d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:17.061086 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ac599a50-b5b6-4d8d-bed0-6feebdb9e11d tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046940 Sep 27 16:43:17.061572 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 419/886] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Sep 27 16:43:17 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 16:43:17.125463 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1e062aa8-0d95-4121-b6bb-6e35e94715c6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:17.125954 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1e062aa8-0d95-4121-b6bb-6e35e94715c6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:17.131752 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1e062aa8-0d95-4121-b6bb-6e35e94715c6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:17.132231 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1e062aa8-0d95-4121-b6bb-6e35e94715c6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:17.132660 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1e062aa8-0d95-4121-b6bb-6e35e94715c6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:17.133343 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1e062aa8-0d95-4121-b6bb-6e35e94715c6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:17.133789 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1e062aa8-0d95-4121-b6bb-6e35e94715c6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:17.134207 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1e062aa8-0d95-4121-b6bb-6e35e94715c6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:17.159001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1e062aa8-0d95-4121-b6bb-6e35e94715c6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 16:43:17.514510 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1e062aa8-0d95-4121-b6bb-6e35e94715c6 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "DELETE /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4" status: 204 len: 0 microversion: 2.1 time: 0.392507 Sep 27 16:43:17.515137 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 468/887] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:43:17 2022] DELETE /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 16:43:17.524711 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0336b04a-aa0a-4bf9-a5a5-7a160c52c538 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:17.525378 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0336b04a-aa0a-4bf9-a5a5-7a160c52c538 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:17.531612 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0336b04a-aa0a-4bf9-a5a5-7a160c52c538 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:17.532098 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0336b04a-aa0a-4bf9-a5a5-7a160c52c538 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:17.532555 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0336b04a-aa0a-4bf9-a5a5-7a160c52c538 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:17.533243 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0336b04a-aa0a-4bf9-a5a5-7a160c52c538 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:17.533696 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0336b04a-aa0a-4bf9-a5a5-7a160c52c538 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:17.534116 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0336b04a-aa0a-4bf9-a5a5-7a160c52c538 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:17.662748 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0336b04a-aa0a-4bf9-a5a5-7a160c52c538 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:17.670375 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0336b04a-aa0a-4bf9-a5a5-7a160c52c538 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4" status: 200 len: 1679 microversion: 2.1 time: 0.149584 Sep 27 16:43:17.670963 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 420/888] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:17 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:18.015645 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-537df39c-c1ce-4224-a3fe-66b68a85226d tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:18.016337 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-537df39c-c1ce-4224-a3fe-66b68a85226d tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:18.022421 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-537df39c-c1ce-4224-a3fe-66b68a85226d tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:18.022788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-537df39c-c1ce-4224-a3fe-66b68a85226d tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:18.023248 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-537df39c-c1ce-4224-a3fe-66b68a85226d tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:18.023942 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-537df39c-c1ce-4224-a3fe-66b68a85226d tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:18.024391 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-537df39c-c1ce-4224-a3fe-66b68a85226d tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:18.024816 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-537df39c-c1ce-4224-a3fe-66b68a85226d tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:18.052287 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2ef77245-3de3-4292-a864-353beb559083 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:18.052893 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2ef77245-3de3-4292-a864-353beb559083 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:18.059354 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ef77245-3de3-4292-a864-353beb559083 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:18.059839 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ef77245-3de3-4292-a864-353beb559083 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:18.060295 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ef77245-3de3-4292-a864-353beb559083 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:18.060999 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ef77245-3de3-4292-a864-353beb559083 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:18.061482 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ef77245-3de3-4292-a864-353beb559083 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:18.061906 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ef77245-3de3-4292-a864-353beb559083 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:18.208387 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-537df39c-c1ce-4224-a3fe-66b68a85226d tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:18.215974 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-537df39c-c1ce-4224-a3fe-66b68a85226d tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1261 microversion: 2.1 time: 0.204521 Sep 27 16:43:18.216747 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 469/889] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:18 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1261 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:18.237383 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2ef77245-3de3-4292-a864-353beb559083 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:18.245715 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2ef77245-3de3-4292-a864-353beb559083 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.197873 Sep 27 16:43:18.246278 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 421/890] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:18 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:43:18.694259 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2ddd8eaf-2841-4ef2-b2d4-8b06585dd4a5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:18.694903 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2ddd8eaf-2841-4ef2-b2d4-8b06585dd4a5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:18.700817 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2ddd8eaf-2841-4ef2-b2d4-8b06585dd4a5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:18.701300 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2ddd8eaf-2841-4ef2-b2d4-8b06585dd4a5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:18.701764 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2ddd8eaf-2841-4ef2-b2d4-8b06585dd4a5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:18.704124 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2ddd8eaf-2841-4ef2-b2d4-8b06585dd4a5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:18.704124 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2ddd8eaf-2841-4ef2-b2d4-8b06585dd4a5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:18.704124 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2ddd8eaf-2841-4ef2-b2d4-8b06585dd4a5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:18.833896 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2ddd8eaf-2841-4ef2-b2d4-8b06585dd4a5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:18.841611 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2ddd8eaf-2841-4ef2-b2d4-8b06585dd4a5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4" status: 200 len: 1679 microversion: 2.1 time: 0.151694 Sep 27 16:43:18.842171 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 470/891] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:18 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:19.239356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-17b21acc-e99d-4165-a9bb-8058cad3f74a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:19.239969 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-17b21acc-e99d-4165-a9bb-8058cad3f74a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:19.246578 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-17b21acc-e99d-4165-a9bb-8058cad3f74a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:19.247085 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-17b21acc-e99d-4165-a9bb-8058cad3f74a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:19.247514 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-17b21acc-e99d-4165-a9bb-8058cad3f74a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:19.248198 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-17b21acc-e99d-4165-a9bb-8058cad3f74a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:19.248674 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-17b21acc-e99d-4165-a9bb-8058cad3f74a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:19.249183 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-17b21acc-e99d-4165-a9bb-8058cad3f74a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:19.272311 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-dc621446-466b-46d5-9fec-84e92f357924 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:19.272311 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-dc621446-466b-46d5-9fec-84e92f357924 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:19.275926 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc621446-466b-46d5-9fec-84e92f357924 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:19.276444 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc621446-466b-46d5-9fec-84e92f357924 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:19.276885 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc621446-466b-46d5-9fec-84e92f357924 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:19.277604 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc621446-466b-46d5-9fec-84e92f357924 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:19.278088 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc621446-466b-46d5-9fec-84e92f357924 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:19.278515 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc621446-466b-46d5-9fec-84e92f357924 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:19.451412 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-17b21acc-e99d-4165-a9bb-8058cad3f74a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:19.459698 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-17b21acc-e99d-4165-a9bb-8058cad3f74a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1261 microversion: 2.1 time: 0.225122 Sep 27 16:43:19.460273 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 422/892] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:19 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1261 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:19.464697 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-dc621446-466b-46d5-9fec-84e92f357924 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:19.472642 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-dc621446-466b-46d5-9fec-84e92f357924 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.207782 Sep 27 16:43:19.473330 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 471/893] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:19 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:19.865759 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7aa593e7-9199-4862-b72e-88c4391d0f8e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:19.866365 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7aa593e7-9199-4862-b72e-88c4391d0f8e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:19.872291 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7aa593e7-9199-4862-b72e-88c4391d0f8e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:19.872768 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7aa593e7-9199-4862-b72e-88c4391d0f8e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:19.873198 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7aa593e7-9199-4862-b72e-88c4391d0f8e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:19.873880 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7aa593e7-9199-4862-b72e-88c4391d0f8e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:19.874334 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7aa593e7-9199-4862-b72e-88c4391d0f8e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:19.874758 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7aa593e7-9199-4862-b72e-88c4391d0f8e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:19.893416 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:20.009637 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7aa593e7-9199-4862-b72e-88c4391d0f8e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:20.018981 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7aa593e7-9199-4862-b72e-88c4391d0f8e tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4" status: 200 len: 1679 microversion: 2.1 time: 0.156460 Sep 27 16:43:20.019597 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 423/894] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:19 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:20.481533 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-142aa2f7-ef21-43ba-ac17-099fbeab11f0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:20.482156 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-142aa2f7-ef21-43ba-ac17-099fbeab11f0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:20.489119 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-142aa2f7-ef21-43ba-ac17-099fbeab11f0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:20.489607 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-142aa2f7-ef21-43ba-ac17-099fbeab11f0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:20.490038 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-142aa2f7-ef21-43ba-ac17-099fbeab11f0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:20.490955 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-142aa2f7-ef21-43ba-ac17-099fbeab11f0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:20.491534 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-142aa2f7-ef21-43ba-ac17-099fbeab11f0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:20.491968 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-142aa2f7-ef21-43ba-ac17-099fbeab11f0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:20.495700 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a00fca4c-de7e-4c59-b19c-404d712ade01 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:20.496316 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a00fca4c-de7e-4c59-b19c-404d712ade01 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:20.503374 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a00fca4c-de7e-4c59-b19c-404d712ade01 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:20.503943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a00fca4c-de7e-4c59-b19c-404d712ade01 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:20.504378 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a00fca4c-de7e-4c59-b19c-404d712ade01 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:20.505069 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a00fca4c-de7e-4c59-b19c-404d712ade01 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:20.505521 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a00fca4c-de7e-4c59-b19c-404d712ade01 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:20.505941 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a00fca4c-de7e-4c59-b19c-404d712ade01 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:20.694002 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-142aa2f7-ef21-43ba-ac17-099fbeab11f0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:20.702014 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a00fca4c-de7e-4c59-b19c-404d712ade01 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:20.702179 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-142aa2f7-ef21-43ba-ac17-099fbeab11f0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1261 microversion: 2.1 time: 0.224443 Sep 27 16:43:20.702882 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 472/895] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:20 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1261 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:20.711013 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a00fca4c-de7e-4c59-b19c-404d712ade01 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.219133 Sep 27 16:43:20.711572 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 424/896] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:20 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:43:21.042125 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1fbc2983-a15c-4cc3-87c1-bee3d8f3565f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:21.042732 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1fbc2983-a15c-4cc3-87c1-bee3d8f3565f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:21.048745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1fbc2983-a15c-4cc3-87c1-bee3d8f3565f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:21.052084 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1fbc2983-a15c-4cc3-87c1-bee3d8f3565f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:21.052084 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1fbc2983-a15c-4cc3-87c1-bee3d8f3565f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:21.052084 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1fbc2983-a15c-4cc3-87c1-bee3d8f3565f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:21.052084 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1fbc2983-a15c-4cc3-87c1-bee3d8f3565f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:21.052486 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1fbc2983-a15c-4cc3-87c1-bee3d8f3565f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:21.179153 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1fbc2983-a15c-4cc3-87c1-bee3d8f3565f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:21.186660 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1fbc2983-a15c-4cc3-87c1-bee3d8f3565f tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4" status: 200 len: 1679 microversion: 2.1 time: 0.148411 Sep 27 16:43:21.187255 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 473/897] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:21 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:21.726015 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-17a9dbdb-b1a7-4242-a1d7-d4c3749de40f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:21.727303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-17a9dbdb-b1a7-4242-a1d7-d4c3749de40f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:21.733436 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-17a9dbdb-b1a7-4242-a1d7-d4c3749de40f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:21.733944 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-17a9dbdb-b1a7-4242-a1d7-d4c3749de40f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:21.734372 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-17a9dbdb-b1a7-4242-a1d7-d4c3749de40f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:21.735082 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-17a9dbdb-b1a7-4242-a1d7-d4c3749de40f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:21.735535 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-17a9dbdb-b1a7-4242-a1d7-d4c3749de40f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:21.736060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7eaefac5-5620-4f11-b8fb-5467e0ff400e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:21.736525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-17a9dbdb-b1a7-4242-a1d7-d4c3749de40f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:21.736810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7eaefac5-5620-4f11-b8fb-5467e0ff400e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:21.744164 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7eaefac5-5620-4f11-b8fb-5467e0ff400e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:21.749907 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7eaefac5-5620-4f11-b8fb-5467e0ff400e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:21.749907 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7eaefac5-5620-4f11-b8fb-5467e0ff400e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:21.749907 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7eaefac5-5620-4f11-b8fb-5467e0ff400e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:21.749907 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7eaefac5-5620-4f11-b8fb-5467e0ff400e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:21.750360 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7eaefac5-5620-4f11-b8fb-5467e0ff400e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:21.938941 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-17a9dbdb-b1a7-4242-a1d7-d4c3749de40f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:21.943348 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7eaefac5-5620-4f11-b8fb-5467e0ff400e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:21.947491 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-17a9dbdb-b1a7-4242-a1d7-d4c3749de40f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1261 microversion: 2.1 time: 0.225899 Sep 27 16:43:21.948065 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 425/898] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:21 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1261 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:21.951334 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7eaefac5-5620-4f11-b8fb-5467e0ff400e tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1265 microversion: 2.1 time: 0.219701 Sep 27 16:43:21.952110 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 474/899] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:21 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:22.210901 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ee1319eb-9f15-45b7-b9af-948730b1ca82 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:22.211454 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ee1319eb-9f15-45b7-b9af-948730b1ca82 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:22.217409 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee1319eb-9f15-45b7-b9af-948730b1ca82 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:22.217897 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee1319eb-9f15-45b7-b9af-948730b1ca82 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:22.218347 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee1319eb-9f15-45b7-b9af-948730b1ca82 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:22.219073 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee1319eb-9f15-45b7-b9af-948730b1ca82 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:22.219532 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee1319eb-9f15-45b7-b9af-948730b1ca82 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:22.219955 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee1319eb-9f15-45b7-b9af-948730b1ca82 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:22.353885 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ee1319eb-9f15-45b7-b9af-948730b1ca82 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:22.361894 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ee1319eb-9f15-45b7-b9af-948730b1ca82 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4" status: 200 len: 1679 microversion: 2.1 time: 0.155202 Sep 27 16:43:22.363344 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 426/900] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:22 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:22.840897 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-248e0010-59f2-400d-be6a-ebfa2b9b768b req-bb3e4ec3-fc18-40a2-914b-871f3b49161a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "742a4313-504c-4882-8811-aafcac933bf4", "name": "network-vif-deleted", "tag": "cf0033be-5776-4a8f-b33f-08ea7fc21985"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:43:22.852026 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-248e0010-59f2-400d-be6a-ebfa2b9b768b req-bb3e4ec3-fc18-40a2-914b-871f3b49161a service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:22.852599 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-248e0010-59f2-400d-be6a-ebfa2b9b768b req-bb3e4ec3-fc18-40a2-914b-871f3b49161a service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:22.853097 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-248e0010-59f2-400d-be6a-ebfa2b9b768b req-bb3e4ec3-fc18-40a2-914b-871f3b49161a service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:22.865653 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-248e0010-59f2-400d-be6a-ebfa2b9b768b req-bb3e4ec3-fc18-40a2-914b-871f3b49161a service nova] Creating event network-vif-deleted:cf0033be-5776-4a8f-b33f-08ea7fc21985 for instance 742a4313-504c-4882-8811-aafcac933bf4 on hv-cinder-85506 Sep 27 16:43:22.870720 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-248e0010-59f2-400d-be6a-ebfa2b9b768b req-bb3e4ec3-fc18-40a2-914b-871f3b49161a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033716 Sep 27 16:43:22.871345 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 475/901] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:43:22.971771 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6500663f-dfe5-4f7c-8805-a1ae8f0d9ecd tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:22.974075 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6500663f-dfe5-4f7c-8805-a1ae8f0d9ecd tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:22.978738 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7fc1e02d-dcb5-43d5-8d83-5975fa7e77cb tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:22.979947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7fc1e02d-dcb5-43d5-8d83-5975fa7e77cb tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:22.982078 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6500663f-dfe5-4f7c-8805-a1ae8f0d9ecd tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:22.983138 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6500663f-dfe5-4f7c-8805-a1ae8f0d9ecd tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:22.983916 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6500663f-dfe5-4f7c-8805-a1ae8f0d9ecd tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:22.984842 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6500663f-dfe5-4f7c-8805-a1ae8f0d9ecd tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:22.985488 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6500663f-dfe5-4f7c-8805-a1ae8f0d9ecd tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:22.986109 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6500663f-dfe5-4f7c-8805-a1ae8f0d9ecd tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:22.987210 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7fc1e02d-dcb5-43d5-8d83-5975fa7e77cb tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:22.987937 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7fc1e02d-dcb5-43d5-8d83-5975fa7e77cb tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:22.988601 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7fc1e02d-dcb5-43d5-8d83-5975fa7e77cb tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:22.989695 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7fc1e02d-dcb5-43d5-8d83-5975fa7e77cb tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:22.990613 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7fc1e02d-dcb5-43d5-8d83-5975fa7e77cb tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:22.991149 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7fc1e02d-dcb5-43d5-8d83-5975fa7e77cb tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:23.198436 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6500663f-dfe5-4f7c-8805-a1ae8f0d9ecd tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:23.207023 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6500663f-dfe5-4f7c-8805-a1ae8f0d9ecd tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1261 microversion: 2.1 time: 0.239222 Sep 27 16:43:23.207241 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7fc1e02d-dcb5-43d5-8d83-5975fa7e77cb tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:23.216533 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7fc1e02d-dcb5-43d5-8d83-5975fa7e77cb tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1452 microversion: 2.1 time: 0.242820 Sep 27 16:43:23.224070 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 476/902] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:22 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1452 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:23.224251 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 427/903] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:22 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1261 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:23.239553 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-adaad770-687c-4f69-8b5e-fed0e966fe7f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:23.240197 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-adaad770-687c-4f69-8b5e-fed0e966fe7f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:23.246133 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-adaad770-687c-4f69-8b5e-fed0e966fe7f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:23.246617 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-adaad770-687c-4f69-8b5e-fed0e966fe7f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:23.247089 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-adaad770-687c-4f69-8b5e-fed0e966fe7f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:23.247781 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-adaad770-687c-4f69-8b5e-fed0e966fe7f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:23.248238 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-adaad770-687c-4f69-8b5e-fed0e966fe7f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:23.248661 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-adaad770-687c-4f69-8b5e-fed0e966fe7f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:23.380439 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-adaad770-687c-4f69-8b5e-fed0e966fe7f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:23.386716 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cf4b06e2-510f-4f7c-bafe-a6b4de63ed32 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:23.387312 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cf4b06e2-510f-4f7c-bafe-a6b4de63ed32 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:23.388909 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-adaad770-687c-4f69-8b5e-fed0e966fe7f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1452 microversion: 2.1 time: 0.153744 Sep 27 16:43:23.389630 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 477/904] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:23 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:23.393539 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf4b06e2-510f-4f7c-bafe-a6b4de63ed32 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:23.394053 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf4b06e2-510f-4f7c-bafe-a6b4de63ed32 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:23.394486 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf4b06e2-510f-4f7c-bafe-a6b4de63ed32 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:23.395247 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf4b06e2-510f-4f7c-bafe-a6b4de63ed32 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:23.395703 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf4b06e2-510f-4f7c-bafe-a6b4de63ed32 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:23.396207 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf4b06e2-510f-4f7c-bafe-a6b4de63ed32 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:23.466095 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-cf4b06e2-510f-4f7c-bafe-a6b4de63ed32 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:23.475200 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-cf4b06e2-510f-4f7c-bafe-a6b4de63ed32 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4" status: 200 len: 1612 microversion: 2.1 time: 0.092206 Sep 27 16:43:23.486924 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 428/905] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:23 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 => generated 1612 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:43:24.231093 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-09e81d15-0f95-4879-b365-37b7c8378020 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:24.231784 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-09e81d15-0f95-4879-b365-37b7c8378020 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:24.237647 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-09e81d15-0f95-4879-b365-37b7c8378020 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:24.238176 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-09e81d15-0f95-4879-b365-37b7c8378020 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:24.238607 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-09e81d15-0f95-4879-b365-37b7c8378020 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:24.240102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-09e81d15-0f95-4879-b365-37b7c8378020 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:24.240549 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-09e81d15-0f95-4879-b365-37b7c8378020 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:24.241148 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-09e81d15-0f95-4879-b365-37b7c8378020 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:24.380667 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-09e81d15-0f95-4879-b365-37b7c8378020 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:24.388820 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-09e81d15-0f95-4879-b365-37b7c8378020 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1261 microversion: 2.1 time: 0.161688 Sep 27 16:43:24.389397 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 478/906] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:24 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:24.499852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dfc349dd-42b6-40d5-a30c-2a7567356d79 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:24.500460 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-dfc349dd-42b6-40d5-a30c-2a7567356d79 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:24.502950 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=69 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:24.507639 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfc349dd-42b6-40d5-a30c-2a7567356d79 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:24.508169 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfc349dd-42b6-40d5-a30c-2a7567356d79 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:24.516233 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfc349dd-42b6-40d5-a30c-2a7567356d79 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:24.516233 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfc349dd-42b6-40d5-a30c-2a7567356d79 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:24.516233 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfc349dd-42b6-40d5-a30c-2a7567356d79 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:24.516233 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfc349dd-42b6-40d5-a30c-2a7567356d79 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:24.573885 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dfc349dd-42b6-40d5-a30c-2a7567356d79 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:24.581586 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-dfc349dd-42b6-40d5-a30c-2a7567356d79 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4" status: 200 len: 1612 microversion: 2.1 time: 0.085603 Sep 27 16:43:24.582179 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 429/907] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:24 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 => generated 1612 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:25.341728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-6cb16506-9409-46a8-8a4a-233f08c2f8a5 req-94a53112-ba8e-453d-bb0e-a59bdf1ce544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50687ace-d869-4712-9cf7-0d16c7244ac7", "tag": "bfce7c0e-1dc8-42b2-b518-7b30f07592fc"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:43:25.352600 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-6cb16506-9409-46a8-8a4a-233f08c2f8a5 req-94a53112-ba8e-453d-bb0e-a59bdf1ce544 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:25.353322 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-6cb16506-9409-46a8-8a4a-233f08c2f8a5 req-94a53112-ba8e-453d-bb0e-a59bdf1ce544 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:25.353869 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-6cb16506-9409-46a8-8a4a-233f08c2f8a5 req-94a53112-ba8e-453d-bb0e-a59bdf1ce544 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:25.372243 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-6cb16506-9409-46a8-8a4a-233f08c2f8a5 req-94a53112-ba8e-453d-bb0e-a59bdf1ce544 service nova] Creating event network-changed:bfce7c0e-1dc8-42b2-b518-7b30f07592fc for instance 50687ace-d869-4712-9cf7-0d16c7244ac7 on hv-cinder-85506 Sep 27 16:43:25.378986 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-6cb16506-9409-46a8-8a4a-233f08c2f8a5 req-94a53112-ba8e-453d-bb0e-a59bdf1ce544 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040930 Sep 27 16:43:25.380738 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 479/908] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:43:25.413829 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9c86b393-e24b-4bfd-90dc-aa13f6df8c57 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:25.415197 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9c86b393-e24b-4bfd-90dc-aa13f6df8c57 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:25.424040 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c86b393-e24b-4bfd-90dc-aa13f6df8c57 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:25.424815 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c86b393-e24b-4bfd-90dc-aa13f6df8c57 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:25.425741 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c86b393-e24b-4bfd-90dc-aa13f6df8c57 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:25.427859 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c86b393-e24b-4bfd-90dc-aa13f6df8c57 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:25.428589 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c86b393-e24b-4bfd-90dc-aa13f6df8c57 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:25.429261 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c86b393-e24b-4bfd-90dc-aa13f6df8c57 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:25.602051 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9c86b393-e24b-4bfd-90dc-aa13f6df8c57 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:25.606524 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1b35e688-1a94-4323-bbd7-c197fe5ad197 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:25.607363 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1b35e688-1a94-4323-bbd7-c197fe5ad197 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:25.616185 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9c86b393-e24b-4bfd-90dc-aa13f6df8c57 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1261 microversion: 2.1 time: 0.206684 Sep 27 16:43:25.616929 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 430/909] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:25 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1261 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:25.622054 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b35e688-1a94-4323-bbd7-c197fe5ad197 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:25.623006 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b35e688-1a94-4323-bbd7-c197fe5ad197 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:25.627603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b35e688-1a94-4323-bbd7-c197fe5ad197 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:25.628963 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b35e688-1a94-4323-bbd7-c197fe5ad197 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:25.630150 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b35e688-1a94-4323-bbd7-c197fe5ad197 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:25.631214 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b35e688-1a94-4323-bbd7-c197fe5ad197 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:25.670248 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b35e688-1a94-4323-bbd7-c197fe5ad197 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:25.671360 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b35e688-1a94-4323-bbd7-c197fe5ad197 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:25.672366 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b35e688-1a94-4323-bbd7-c197fe5ad197 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:25.673023 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-1b35e688-1a94-4323-bbd7-c197fe5ad197 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lazy-loading 'fault' on Instance uuid 742a4313-504c-4882-8811-aafcac933bf4 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:43:25.746581 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1b35e688-1a94-4323-bbd7-c197fe5ad197 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3af2b82b641aea11ebf79677a3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fad530905b485cb7141793f6130a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:25.759646 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1b35e688-1a94-4323-bbd7-c197fe5ad197 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4" status: 200 len: 1331 microversion: 2.1 time: 0.156451 Sep 27 16:43:25.780895 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 480/910] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:25 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 => generated 1331 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:43:26.644729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7fb1f1a5-cf8e-4343-ad30-a74f642d19fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:26.645764 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7fb1f1a5-cf8e-4343-ad30-a74f642d19fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:26.652054 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7fb1f1a5-cf8e-4343-ad30-a74f642d19fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:26.652663 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7fb1f1a5-cf8e-4343-ad30-a74f642d19fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:26.653220 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7fb1f1a5-cf8e-4343-ad30-a74f642d19fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:26.654296 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7fb1f1a5-cf8e-4343-ad30-a74f642d19fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:26.654879 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7fb1f1a5-cf8e-4343-ad30-a74f642d19fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:26.655546 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7fb1f1a5-cf8e-4343-ad30-a74f642d19fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:26.795894 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7fb1f1a5-cf8e-4343-ad30-a74f642d19fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:26.804745 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7fb1f1a5-cf8e-4343-ad30-a74f642d19fa tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1261 microversion: 2.1 time: 0.163979 Sep 27 16:43:26.805322 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 431/911] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:26 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:26.807674 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7859e25c-6d7b-4048-992b-df0c91a66b49 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:26.808330 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7859e25c-6d7b-4048-992b-df0c91a66b49 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:26.814278 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7859e25c-6d7b-4048-992b-df0c91a66b49 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:26.814767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7859e25c-6d7b-4048-992b-df0c91a66b49 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:26.815239 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7859e25c-6d7b-4048-992b-df0c91a66b49 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:26.815940 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7859e25c-6d7b-4048-992b-df0c91a66b49 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:26.816400 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7859e25c-6d7b-4048-992b-df0c91a66b49 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:26.817526 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7859e25c-6d7b-4048-992b-df0c91a66b49 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:26.831093 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-7859e25c-6d7b-4048-992b-df0c91a66b49 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] HTTP exception thrown: Instance 742a4313-504c-4882-8811-aafcac933bf4 could not be found. Sep 27 16:43:26.837270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7859e25c-6d7b-4048-992b-df0c91a66b49 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Request method failure captured: Sep 27 16:43:26.837270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 HTTP/1.1 Sep 27 16:43:26.837270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:43:26.837270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:43:26.837270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:43:26.837270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:43:26.837270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:43:26.837270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:43:26.837270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:43:26.837270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:43:26.837270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMyaXt7kpD0PfNVvLYuBuVZ7HRidwt4V7Ad9Ym3_Vbex0YLxAbLBHGS-HGBld9NGzCqyRTvioGgsu3eg4VIjDtZIgTd01qZ6DSQMCZ0BknQO4xdhtqMgcyIwM-7CdV1bNe00wPntnIGZvSkxLDfg4QN7aDekfETC-lFwzlHlACFvCF14 Sep 27 16:43:26.837270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:43:26.837270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:43:26.837270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:43:26.837270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:43:26.837270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:43:26.837270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:43:26.837270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:43:26.837270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:26.837270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:43:26.837270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:43:26.839002 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_73fad530905b485cb7141793f6130a9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/73fad530905b485cb7141793f6130a9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:43:26.839002 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:26.839002 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:43:26.839002 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:26.839002 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:43:26.839002 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:43:26.839002 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:43:26.839002 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: e8d3af2b82b641aea11ebf79677a3af1 Sep 27 16:43:26.839002 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:43:26.839002 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:43:26.839002 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Instance 742a4313-504c-4882-8811-aafcac933bf4 could not be found. Sep 27 16:43:26.839002 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': '742a4313-504c-4882-8811-aafcac933bf4'} Sep 27 16:43:26.839947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:43:26.839947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:26.839947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:43:26.839947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:43:26.839947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:43:26.839947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:43:26.839947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:43:26.839947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:43:26.839947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:43:26.839947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:43:26.839947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 742a4313-504c-4882-8811-aafcac933bf4 could not be found. Sep 27 16:43:26.839947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:26.839947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:43:26.839947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:26.839947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:26.839947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:43:26.839947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:43:26.839947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:43:26.839947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:43:26.839947 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:43:26.841520 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:43:26.841520 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:43:26.841520 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:43:26.841520 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:43:26.841520 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:43:26.841520 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:43:26.841520 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:43:26.841520 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 742a4313-504c-4882-8811-aafcac933bf4 could not be found. Sep 27 16:43:26.841520 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:26.841520 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:43:26.841520 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:26.841520 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:26.841520 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:43:26.841520 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:43:26.841520 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:43:26.841520 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:43:26.841520 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 742a4313-504c-4882-8811-aafcac933bf4 could not be found. Sep 27 16:43:26.841520 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:26.842921 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7859e25c-6d7b-4048-992b-df0c91a66b49 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Returning 404 to user: Instance 742a4313-504c-4882-8811-aafcac933bf4 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:43:26.842921 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7859e25c-6d7b-4048-992b-df0c91a66b49 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4" status: 404 len: 111 microversion: 2.1 time: 0.032972 Sep 27 16:43:26.842921 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 481/912] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:26 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 16:43:26.844241 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-18b4a773-a5cc-4619-a587-4f36b7bb6cb8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '.version_select at 0x7fa405612a60>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:26.993875 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-18b4a773-a5cc-4619-a587-4f36b7bb6cb8 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2035466754" status: 202 len: 0 microversion: 2.1 time: 0.153295 Sep 27 16:43:26.997715 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 432/913] 10.222.0.64 () {58 vars in 1221 bytes} [Tue Sep 27 16:43:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2035466754 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:43:27.375869 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-8991d6bd-9736-4735-a974-4e7356c3affe req-e44199a1-7b3a-4407-afce-a8e569d942ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800233b1-cc79-4eb5-9cdf-ff21e8321268", "name": "network-vif-plugged", "status": "completed", "tag": "c6777043-34a8-4a48-b945-7f80df4e0022"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:43:27.386479 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8991d6bd-9736-4735-a974-4e7356c3affe req-e44199a1-7b3a-4407-afce-a8e569d942ad service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:27.387082 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8991d6bd-9736-4735-a974-4e7356c3affe req-e44199a1-7b3a-4407-afce-a8e569d942ad service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:27.387585 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8991d6bd-9736-4735-a974-4e7356c3affe req-e44199a1-7b3a-4407-afce-a8e569d942ad service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:27.391607 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:27.400954 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-8991d6bd-9736-4735-a974-4e7356c3affe req-e44199a1-7b3a-4407-afce-a8e569d942ad service nova] Creating event network-vif-plugged:c6777043-34a8-4a48-b945-7f80df4e0022 for instance 800233b1-cc79-4eb5-9cdf-ff21e8321268 on hv-cinder-85506 Sep 27 16:43:27.406141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-8991d6bd-9736-4735-a974-4e7356c3affe req-e44199a1-7b3a-4407-afce-a8e569d942ad service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033912 Sep 27 16:43:27.407045 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 482/914] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:43:27.828538 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c5564ab4-77ec-4f87-b4c3-fd314c107b17 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:27.829142 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c5564ab4-77ec-4f87-b4c3-fd314c107b17 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:27.836369 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c5564ab4-77ec-4f87-b4c3-fd314c107b17 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:27.836849 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c5564ab4-77ec-4f87-b4c3-fd314c107b17 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:27.837278 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c5564ab4-77ec-4f87-b4c3-fd314c107b17 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:27.838185 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c5564ab4-77ec-4f87-b4c3-fd314c107b17 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:27.838633 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c5564ab4-77ec-4f87-b4c3-fd314c107b17 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:27.839148 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c5564ab4-77ec-4f87-b4c3-fd314c107b17 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:27.994477 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c5564ab4-77ec-4f87-b4c3-fd314c107b17 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:28.002832 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c5564ab4-77ec-4f87-b4c3-fd314c107b17 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1261 microversion: 2.1 time: 0.178595 Sep 27 16:43:28.005603 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 433/915] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:27 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:29.033788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6784a598-43f9-4e6f-951f-bb4ddb1f7b2f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:29.034489 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6784a598-43f9-4e6f-951f-bb4ddb1f7b2f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:29.042103 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6784a598-43f9-4e6f-951f-bb4ddb1f7b2f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:29.042587 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6784a598-43f9-4e6f-951f-bb4ddb1f7b2f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:29.043107 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6784a598-43f9-4e6f-951f-bb4ddb1f7b2f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:29.043760 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6784a598-43f9-4e6f-951f-bb4ddb1f7b2f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:29.044213 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6784a598-43f9-4e6f-951f-bb4ddb1f7b2f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:29.044639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6784a598-43f9-4e6f-951f-bb4ddb1f7b2f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:29.055224 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9feb2aaf-f491-4c0d-bad6-d9eda4cf9f10 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:29.055842 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9feb2aaf-f491-4c0d-bad6-d9eda4cf9f10 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:29.062314 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9feb2aaf-f491-4c0d-bad6-d9eda4cf9f10 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:29.062825 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9feb2aaf-f491-4c0d-bad6-d9eda4cf9f10 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:29.063263 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9feb2aaf-f491-4c0d-bad6-d9eda4cf9f10 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:29.064076 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9feb2aaf-f491-4c0d-bad6-d9eda4cf9f10 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:29.064529 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9feb2aaf-f491-4c0d-bad6-d9eda4cf9f10 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:29.064955 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9feb2aaf-f491-4c0d-bad6-d9eda4cf9f10 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:29.078800 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-9feb2aaf-f491-4c0d-bad6-d9eda4cf9f10 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] HTTP exception thrown: Instance 742a4313-504c-4882-8811-aafcac933bf4 could not be found. Sep 27 16:43:29.080733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9feb2aaf-f491-4c0d-bad6-d9eda4cf9f10 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Request method failure captured: Sep 27 16:43:29.080733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 HTTP/1.1 Sep 27 16:43:29.080733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:43:29.080733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:43:29.080733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:43:29.080733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 27 16:43:29.080733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:43:29.080733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:43:29.080733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:43:29.080733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:43:29.080733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMyaXt7kpD0PfNVvLYuBuVZ7HRidwt4V7Ad9Ym3_Vbex0YLxAbLBHGS-HGBld9NGzCqyRTvioGgsu3eg4VIjDtZIgTd01qZ6DSQMCZ0BknQO4xdhtqMgcyIwM-7CdV1bNe00wPntnIGZvSkxLDfg4QN7aDekfETC-lFwzlHlACFvCF14 Sep 27 16:43:29.080733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:43:29.080733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:43:29.080733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:43:29.080733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:43:29.080733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:43:29.080733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:43:29.080733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:43:29.080733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:29.080733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:43:29.080733 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:43:29.082854 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_73fad530905b485cb7141793f6130a9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/73fad530905b485cb7141793f6130a9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:43:29.082854 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:29.082854 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:43:29.082854 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:29.082854 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:43:29.082854 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:43:29.082854 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:43:29.082854 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: e8d3af2b82b641aea11ebf79677a3af1 Sep 27 16:43:29.082854 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:43:29.082854 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: > Sep 27 16:43:29.082854 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Instance 742a4313-504c-4882-8811-aafcac933bf4 could not be found. Sep 27 16:43:29.082854 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'id': '742a4313-504c-4882-8811-aafcac933bf4'} Sep 27 16:43:29.084127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:43:29.084127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:29.084127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:43:29.084127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:43:29.084127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:43:29.084127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:43:29.084127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:43:29.084127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:43:29.084127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:43:29.084127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:43:29.084127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 742a4313-504c-4882-8811-aafcac933bf4 could not be found. Sep 27 16:43:29.084127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:43:29.084127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:43:29.084127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:43:29.084127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:29.084127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:43:29.084127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:43:29.084127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:43:29.084127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:43:29.084127 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:43:29.085537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:43:29.085537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 16:43:29.085537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 16:43:29.085537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 16:43:29.085537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 16:43:29.085537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:43:29.085537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:43:29.085537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:43:29.085537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:43:29.085537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 742a4313-504c-4882-8811-aafcac933bf4 could not be found. Sep 27 16:43:29.085537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:43:29.085537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:43:29.085537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:43:29.085537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:29.085537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:43:29.085537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:43:29.085537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:43:29.085537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:43:29.085537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 742a4313-504c-4882-8811-aafcac933bf4 could not be found. Sep 27 16:43:29.085537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:43:29.104224 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9feb2aaf-f491-4c0d-bad6-d9eda4cf9f10 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Returning 404 to user: Instance 742a4313-504c-4882-8811-aafcac933bf4 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:43:29.104224 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9feb2aaf-f491-4c0d-bad6-d9eda4cf9f10 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "DELETE /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4" status: 404 len: 111 microversion: 2.1 time: 0.030957 Sep 27 16:43:29.104224 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 434/916] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:43:29 2022] DELETE /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 16:43:29.104224 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3f1fbfa7-067b-4fe5-a0c6-c0b7e36d6f58 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:29.104224 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3f1fbfa7-067b-4fe5-a0c6-c0b7e36d6f58 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 742a4313-504c-4882-8811-aafcac933bf4] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:29.105394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3f1fbfa7-067b-4fe5-a0c6-c0b7e36d6f58 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:29.105394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3f1fbfa7-067b-4fe5-a0c6-c0b7e36d6f58 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:29.105394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3f1fbfa7-067b-4fe5-a0c6-c0b7e36d6f58 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:29.105394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3f1fbfa7-067b-4fe5-a0c6-c0b7e36d6f58 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:29.105736 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3f1fbfa7-067b-4fe5-a0c6-c0b7e36d6f58 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:29.105736 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3f1fbfa7-067b-4fe5-a0c6-c0b7e36d6f58 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:29.124227 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-3f1fbfa7-067b-4fe5-a0c6-c0b7e36d6f58 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] HTTP exception thrown: Instance 742a4313-504c-4882-8811-aafcac933bf4 could not be found. Sep 27 16:43:29.125781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3f1fbfa7-067b-4fe5-a0c6-c0b7e36d6f58 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Request method failure captured: Sep 27 16:43:29.125781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 HTTP/1.1 Sep 27 16:43:29.125781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:43:29.125781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:43:29.125781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:43:29.125781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 27 16:43:29.125781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:43:29.125781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:43:29.125781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:43:29.125781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:43:29.125781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMyaXt7kpD0PfNVvLYuBuVZ7HRidwt4V7Ad9Ym3_Vbex0YLxAbLBHGS-HGBld9NGzCqyRTvioGgsu3eg4VIjDtZIgTd01qZ6DSQMCZ0BknQO4xdhtqMgcyIwM-7CdV1bNe00wPntnIGZvSkxLDfg4QN7aDekfETC-lFwzlHlACFvCF14 Sep 27 16:43:29.125781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:43:29.125781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:43:29.125781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:43:29.125781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:43:29.125781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:43:29.125781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:43:29.125781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:43:29.125781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:29.125781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:43:29.125781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:43:29.127406 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_73fad530905b485cb7141793f6130a9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/73fad530905b485cb7141793f6130a9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:43:29.127406 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:29.127406 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:43:29.127406 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:29.127406 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:43:29.127406 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:43:29.127406 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:43:29.127406 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: e8d3af2b82b641aea11ebf79677a3af1 Sep 27 16:43:29.127406 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:43:29.127406 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: > Sep 27 16:43:29.127406 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Instance 742a4313-504c-4882-8811-aafcac933bf4 could not be found. Sep 27 16:43:29.127406 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'id': '742a4313-504c-4882-8811-aafcac933bf4'} Sep 27 16:43:29.128408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:43:29.128408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:29.128408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:43:29.128408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:43:29.128408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:43:29.128408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:43:29.128408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:43:29.128408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:43:29.128408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:43:29.128408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:43:29.128408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 742a4313-504c-4882-8811-aafcac933bf4 could not be found. Sep 27 16:43:29.128408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:43:29.128408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:43:29.128408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:43:29.128408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:29.128408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:43:29.128408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:43:29.128408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:43:29.128408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:43:29.128408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:43:29.129852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:43:29.129852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:43:29.129852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:43:29.129852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:43:29.129852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:43:29.129852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:43:29.129852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:43:29.129852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 742a4313-504c-4882-8811-aafcac933bf4 could not be found. Sep 27 16:43:29.129852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:43:29.129852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:43:29.129852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:43:29.129852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:29.129852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:43:29.129852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:43:29.129852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:43:29.129852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:43:29.129852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 742a4313-504c-4882-8811-aafcac933bf4 could not be found. Sep 27 16:43:29.129852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:43:29.131280 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3f1fbfa7-067b-4fe5-a0c6-c0b7e36d6f58 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Returning 404 to user: Instance 742a4313-504c-4882-8811-aafcac933bf4 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:43:29.131280 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3f1fbfa7-067b-4fe5-a0c6-c0b7e36d6f58 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4" status: 404 len: 111 microversion: 2.1 time: 0.038049 Sep 27 16:43:29.131280 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 435/917] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:29 2022] GET /compute/v2.1/servers/742a4313-504c-4882-8811-aafcac933bf4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:43:29.181404 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6784a598-43f9-4e6f-951f-bb4ddb1f7b2f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:29.189098 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6784a598-43f9-4e6f-951f-bb4ddb1f7b2f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1261 microversion: 2.1 time: 0.160226 Sep 27 16:43:29.189668 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 483/918] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:29 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:30.212246 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fb238295-c48d-4ae8-913f-b040b03f9b78 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:30.212859 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fb238295-c48d-4ae8-913f-b040b03f9b78 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:30.219230 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb238295-c48d-4ae8-913f-b040b03f9b78 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:30.219713 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb238295-c48d-4ae8-913f-b040b03f9b78 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:30.220147 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb238295-c48d-4ae8-913f-b040b03f9b78 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:30.220833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb238295-c48d-4ae8-913f-b040b03f9b78 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:30.221287 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb238295-c48d-4ae8-913f-b040b03f9b78 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:30.221712 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb238295-c48d-4ae8-913f-b040b03f9b78 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:30.350566 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fb238295-c48d-4ae8-913f-b040b03f9b78 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:30.358420 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fb238295-c48d-4ae8-913f-b040b03f9b78 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1261 microversion: 2.1 time: 0.149984 Sep 27 16:43:30.359019 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 436/919] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:30 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:31.382147 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b7d01136-2dee-4d49-bf82-3327fbc1cb96 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:31.382767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b7d01136-2dee-4d49-bf82-3327fbc1cb96 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:31.388812 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7d01136-2dee-4d49-bf82-3327fbc1cb96 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:31.389298 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7d01136-2dee-4d49-bf82-3327fbc1cb96 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:31.389733 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7d01136-2dee-4d49-bf82-3327fbc1cb96 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:31.390417 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7d01136-2dee-4d49-bf82-3327fbc1cb96 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:31.390904 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7d01136-2dee-4d49-bf82-3327fbc1cb96 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:31.391329 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7d01136-2dee-4d49-bf82-3327fbc1cb96 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:31.529484 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b7d01136-2dee-4d49-bf82-3327fbc1cb96 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:31.537355 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b7d01136-2dee-4d49-bf82-3327fbc1cb96 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1261 microversion: 2.1 time: 0.159509 Sep 27 16:43:31.537920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 484/920] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:31 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:32.492566 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ca652eb2-b01e-48a0-af7a-6a382317216a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:32.492566 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ca652eb2-b01e-48a0-af7a-6a382317216a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:32.499457 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca652eb2-b01e-48a0-af7a-6a382317216a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:32.499947 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca652eb2-b01e-48a0-af7a-6a382317216a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:32.500397 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca652eb2-b01e-48a0-af7a-6a382317216a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:32.501069 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca652eb2-b01e-48a0-af7a-6a382317216a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:32.501525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca652eb2-b01e-48a0-af7a-6a382317216a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:32.501949 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca652eb2-b01e-48a0-af7a-6a382317216a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:32.517401 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-ca652eb2-b01e-48a0-af7a-6a382317216a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] HTTP exception thrown: Instance e036d20a-962b-4196-8b51-1edc199c9700 could not be found. Sep 27 16:43:32.517784 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ca652eb2-b01e-48a0-af7a-6a382317216a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Request method failure captured: Sep 27 16:43:32.517784 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 HTTP/1.1 Sep 27 16:43:32.517784 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:43:32.517784 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:43:32.517784 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:43:32.517784 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 27 16:43:32.517784 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:43:32.517784 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:43:32.517784 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:43:32.517784 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:43:32.517784 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMyaXt7kpD0PfNVvLYuBuVZ7HRidwt4V7Ad9Ym3_Vbex0YLxAbLBHGS-HGBld9NGzCqyRTvioGgsu3eg4VIjDtZIgTd01qZ6DSQMCZ0BknQO4xdhtqMgcyIwM-7CdV1bNe00wPntnIGZvSkxLDfg4QN7aDekfETC-lFwzlHlACFvCF14 Sep 27 16:43:32.517784 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:43:32.517784 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:43:32.517784 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:43:32.517784 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:43:32.517784 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:43:32.517784 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:43:32.517784 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:43:32.517784 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:32.517784 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:43:32.517784 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:43:32.519163 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_73fad530905b485cb7141793f6130a9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/73fad530905b485cb7141793f6130a9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:43:32.519163 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:32.519163 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:43:32.519163 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:32.519163 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:43:32.519163 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:43:32.519163 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:43:32.519163 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: e8d3af2b82b641aea11ebf79677a3af1 Sep 27 16:43:32.519163 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:43:32.519163 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: > Sep 27 16:43:32.519163 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Instance e036d20a-962b-4196-8b51-1edc199c9700 could not be found. Sep 27 16:43:32.519163 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'id': 'e036d20a-962b-4196-8b51-1edc199c9700'} Sep 27 16:43:32.519919 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:43:32.519919 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:32.519919 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:43:32.519919 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:43:32.519919 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:43:32.519919 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:43:32.519919 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:43:32.519919 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:43:32.519919 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:43:32.519919 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:43:32.519919 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e036d20a-962b-4196-8b51-1edc199c9700 could not be found. Sep 27 16:43:32.519919 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:43:32.519919 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:43:32.519919 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:43:32.519919 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:32.519919 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:43:32.519919 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:43:32.519919 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:43:32.519919 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:43:32.519919 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:43:32.521811 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:43:32.521811 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 16:43:32.521811 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 16:43:32.521811 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 16:43:32.521811 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 16:43:32.521811 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:43:32.521811 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:43:32.521811 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:43:32.521811 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:43:32.521811 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e036d20a-962b-4196-8b51-1edc199c9700 could not be found. Sep 27 16:43:32.521811 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:43:32.521811 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:43:32.521811 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:43:32.521811 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:32.521811 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:43:32.521811 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:43:32.521811 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:43:32.521811 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:43:32.521811 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e036d20a-962b-4196-8b51-1edc199c9700 could not be found. Sep 27 16:43:32.521811 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:43:32.523442 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ca652eb2-b01e-48a0-af7a-6a382317216a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Returning 404 to user: Instance e036d20a-962b-4196-8b51-1edc199c9700 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:43:32.523442 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ca652eb2-b01e-48a0-af7a-6a382317216a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 404 len: 111 microversion: 2.1 time: 0.032710 Sep 27 16:43:32.523442 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 437/921] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:43:32 2022] DELETE /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:43:32.528460 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-70f8ddef-2734-497b-868d-460d06dbe541 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:32.529467 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-70f8ddef-2734-497b-868d-460d06dbe541 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: e036d20a-962b-4196-8b51-1edc199c9700] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:32.535517 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70f8ddef-2734-497b-868d-460d06dbe541 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:32.535997 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70f8ddef-2734-497b-868d-460d06dbe541 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:32.536432 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70f8ddef-2734-497b-868d-460d06dbe541 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:32.537842 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70f8ddef-2734-497b-868d-460d06dbe541 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:32.538297 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70f8ddef-2734-497b-868d-460d06dbe541 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:32.538720 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70f8ddef-2734-497b-868d-460d06dbe541 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:32.552123 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-70f8ddef-2734-497b-868d-460d06dbe541 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] HTTP exception thrown: Instance e036d20a-962b-4196-8b51-1edc199c9700 could not be found. Sep 27 16:43:32.553833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-70f8ddef-2734-497b-868d-460d06dbe541 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Request method failure captured: Sep 27 16:43:32.553833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 HTTP/1.1 Sep 27 16:43:32.553833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:43:32.553833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:43:32.553833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:43:32.553833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:43:32.553833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:43:32.553833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:43:32.553833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:43:32.553833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:43:32.553833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMyaXt7kpD0PfNVvLYuBuVZ7HRidwt4V7Ad9Ym3_Vbex0YLxAbLBHGS-HGBld9NGzCqyRTvioGgsu3eg4VIjDtZIgTd01qZ6DSQMCZ0BknQO4xdhtqMgcyIwM-7CdV1bNe00wPntnIGZvSkxLDfg4QN7aDekfETC-lFwzlHlACFvCF14 Sep 27 16:43:32.553833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:43:32.553833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:43:32.553833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:43:32.553833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:43:32.553833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:43:32.553833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:43:32.553833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:43:32.553833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:32.553833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:43:32.553833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:43:32.555493 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_73fad530905b485cb7141793f6130a9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/73fad530905b485cb7141793f6130a9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:43:32.555493 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:32.555493 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:43:32.555493 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:32.555493 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:43:32.555493 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:43:32.555493 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:43:32.555493 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: e8d3af2b82b641aea11ebf79677a3af1 Sep 27 16:43:32.555493 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:43:32.555493 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:43:32.555493 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Instance e036d20a-962b-4196-8b51-1edc199c9700 could not be found. Sep 27 16:43:32.555493 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': 'e036d20a-962b-4196-8b51-1edc199c9700'} Sep 27 16:43:32.556535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:43:32.556535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:32.556535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:43:32.556535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:43:32.556535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:43:32.556535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:43:32.556535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:43:32.556535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:43:32.556535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:43:32.556535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:43:32.556535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e036d20a-962b-4196-8b51-1edc199c9700 could not be found. Sep 27 16:43:32.556535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:32.556535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:43:32.556535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:32.556535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:32.556535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:43:32.556535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:43:32.556535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:43:32.556535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:43:32.556535 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:43:32.558001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:43:32.558001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:43:32.558001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:43:32.558001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:43:32.558001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:43:32.558001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:43:32.558001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:43:32.558001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e036d20a-962b-4196-8b51-1edc199c9700 could not be found. Sep 27 16:43:32.558001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:32.558001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:43:32.558001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:32.558001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:32.558001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:43:32.558001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:43:32.558001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:43:32.558001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:43:32.558001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e036d20a-962b-4196-8b51-1edc199c9700 could not be found. Sep 27 16:43:32.558001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:32.559310 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-70f8ddef-2734-497b-868d-460d06dbe541 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Returning 404 to user: Instance e036d20a-962b-4196-8b51-1edc199c9700 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:43:32.559310 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-70f8ddef-2734-497b-868d-460d06dbe541 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700" status: 404 len: 111 microversion: 2.1 time: 0.030668 Sep 27 16:43:32.559310 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 485/922] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:32 2022] GET /compute/v2.1/servers/e036d20a-962b-4196-8b51-1edc199c9700 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:43:32.564766 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fe2ca96f-3c9b-4ea8-bf39-4c32660633f5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:32.564947 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ef390ad3-48bf-44d0-9584-139079239aa2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:32.565310 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fe2ca96f-3c9b-4ea8-bf39-4c32660633f5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:32.565512 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ef390ad3-48bf-44d0-9584-139079239aa2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:32.571629 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fe2ca96f-3c9b-4ea8-bf39-4c32660633f5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:32.571775 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef390ad3-48bf-44d0-9584-139079239aa2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:32.571995 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fe2ca96f-3c9b-4ea8-bf39-4c32660633f5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:32.572174 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef390ad3-48bf-44d0-9584-139079239aa2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:32.572422 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fe2ca96f-3c9b-4ea8-bf39-4c32660633f5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:32.572654 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef390ad3-48bf-44d0-9584-139079239aa2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:32.573108 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fe2ca96f-3c9b-4ea8-bf39-4c32660633f5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:32.573390 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef390ad3-48bf-44d0-9584-139079239aa2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:32.573555 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fe2ca96f-3c9b-4ea8-bf39-4c32660633f5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:32.573878 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef390ad3-48bf-44d0-9584-139079239aa2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:32.573977 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fe2ca96f-3c9b-4ea8-bf39-4c32660633f5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:32.574321 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef390ad3-48bf-44d0-9584-139079239aa2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:32.588522 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-fe2ca96f-3c9b-4ea8-bf39-4c32660633f5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] HTTP exception thrown: Instance c2bb023b-8f1e-4e58-969b-e6c56395acca could not be found. Sep 27 16:43:32.590060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fe2ca96f-3c9b-4ea8-bf39-4c32660633f5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Request method failure captured: Sep 27 16:43:32.590060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: DELETE /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca HTTP/1.1 Sep 27 16:43:32.590060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:43:32.590060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:43:32.590060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:43:32.590060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:43:32.590060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:43:32.590060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:43:32.590060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:43:32.590060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:43:32.590060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMyaXt7kpD0PfNVvLYuBuVZ7HRidwt4V7Ad9Ym3_Vbex0YLxAbLBHGS-HGBld9NGzCqyRTvioGgsu3eg4VIjDtZIgTd01qZ6DSQMCZ0BknQO4xdhtqMgcyIwM-7CdV1bNe00wPntnIGZvSkxLDfg4QN7aDekfETC-lFwzlHlACFvCF14 Sep 27 16:43:32.590060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:43:32.590060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:43:32.590060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:43:32.590060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:43:32.590060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:43:32.590060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:43:32.590060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:43:32.590060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:32.590060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:43:32.590060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:43:32.591800 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_73fad530905b485cb7141793f6130a9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/73fad530905b485cb7141793f6130a9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:43:32.591800 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:32.591800 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:43:32.591800 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:32.591800 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:43:32.591800 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:43:32.591800 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:43:32.591800 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: e8d3af2b82b641aea11ebf79677a3af1 Sep 27 16:43:32.591800 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:43:32.591800 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:43:32.591800 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Instance c2bb023b-8f1e-4e58-969b-e6c56395acca could not be found. Sep 27 16:43:32.591800 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': 'c2bb023b-8f1e-4e58-969b-e6c56395acca'} Sep 27 16:43:32.592845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:43:32.592845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:32.592845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:43:32.592845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:43:32.592845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:43:32.592845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:43:32.592845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:43:32.592845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:43:32.592845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:43:32.592845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:43:32.592845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2bb023b-8f1e-4e58-969b-e6c56395acca could not be found. Sep 27 16:43:32.592845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:32.592845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:43:32.592845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:32.592845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:32.592845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:43:32.592845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:43:32.592845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:43:32.592845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:43:32.592845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:43:32.594141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:43:32.594141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 16:43:32.594141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 16:43:32.594141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 16:43:32.594141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 16:43:32.594141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:43:32.594141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:43:32.594141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:43:32.594141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:43:32.594141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2bb023b-8f1e-4e58-969b-e6c56395acca could not be found. Sep 27 16:43:32.594141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:32.594141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:43:32.594141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:32.594141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:32.594141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:43:32.594141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:43:32.594141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:43:32.594141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:43:32.594141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2bb023b-8f1e-4e58-969b-e6c56395acca could not be found. Sep 27 16:43:32.594141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:32.595787 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fe2ca96f-3c9b-4ea8-bf39-4c32660633f5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Returning 404 to user: Instance c2bb023b-8f1e-4e58-969b-e6c56395acca could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:43:32.595787 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fe2ca96f-3c9b-4ea8-bf39-4c32660633f5 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 404 len: 111 microversion: 2.1 time: 0.030220 Sep 27 16:43:32.595787 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 486/923] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:43:32 2022] DELETE /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:43:32.600707 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c868ab90-341d-4a22-82b1-b1795e2e097a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:32.601309 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c868ab90-341d-4a22-82b1-b1795e2e097a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: c2bb023b-8f1e-4e58-969b-e6c56395acca] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:32.607058 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c868ab90-341d-4a22-82b1-b1795e2e097a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:32.607539 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c868ab90-341d-4a22-82b1-b1795e2e097a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:32.607970 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c868ab90-341d-4a22-82b1-b1795e2e097a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:32.608656 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c868ab90-341d-4a22-82b1-b1795e2e097a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:32.609101 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c868ab90-341d-4a22-82b1-b1795e2e097a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:32.609522 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c868ab90-341d-4a22-82b1-b1795e2e097a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:32.623178 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-c868ab90-341d-4a22-82b1-b1795e2e097a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] HTTP exception thrown: Instance c2bb023b-8f1e-4e58-969b-e6c56395acca could not be found. Sep 27 16:43:32.625788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c868ab90-341d-4a22-82b1-b1795e2e097a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Request method failure captured: Sep 27 16:43:32.625788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca HTTP/1.1 Sep 27 16:43:32.625788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:43:32.625788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:43:32.625788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:43:32.625788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:43:32.625788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:43:32.625788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:43:32.625788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:43:32.625788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:43:32.625788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMyaXt7kpD0PfNVvLYuBuVZ7HRidwt4V7Ad9Ym3_Vbex0YLxAbLBHGS-HGBld9NGzCqyRTvioGgsu3eg4VIjDtZIgTd01qZ6DSQMCZ0BknQO4xdhtqMgcyIwM-7CdV1bNe00wPntnIGZvSkxLDfg4QN7aDekfETC-lFwzlHlACFvCF14 Sep 27 16:43:32.625788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:43:32.625788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:43:32.625788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:43:32.625788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:43:32.625788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:43:32.625788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:43:32.625788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:43:32.625788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:32.625788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:43:32.625788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:43:32.627501 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_73fad530905b485cb7141793f6130a9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/73fad530905b485cb7141793f6130a9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:43:32.627501 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:32.627501 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:43:32.627501 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:32.627501 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:43:32.627501 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:43:32.627501 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:43:32.627501 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: e8d3af2b82b641aea11ebf79677a3af1 Sep 27 16:43:32.627501 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:43:32.627501 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:43:32.627501 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Instance c2bb023b-8f1e-4e58-969b-e6c56395acca could not be found. Sep 27 16:43:32.627501 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': 'c2bb023b-8f1e-4e58-969b-e6c56395acca'} Sep 27 16:43:32.628401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:43:32.628401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:32.628401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:43:32.628401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:43:32.628401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:43:32.628401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:43:32.628401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:43:32.628401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:43:32.628401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:43:32.628401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:43:32.628401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2bb023b-8f1e-4e58-969b-e6c56395acca could not be found. Sep 27 16:43:32.628401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:32.628401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:43:32.628401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:32.628401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:32.628401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:43:32.628401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:43:32.628401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:43:32.628401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:43:32.628401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:43:32.630251 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:43:32.630251 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:43:32.630251 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:43:32.630251 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:43:32.630251 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:43:32.630251 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:43:32.630251 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:43:32.630251 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2bb023b-8f1e-4e58-969b-e6c56395acca could not be found. Sep 27 16:43:32.630251 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:32.630251 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:43:32.630251 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:32.630251 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:32.630251 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:43:32.630251 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:43:32.630251 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:43:32.630251 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:43:32.630251 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2bb023b-8f1e-4e58-969b-e6c56395acca could not be found. Sep 27 16:43:32.630251 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:32.631843 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c868ab90-341d-4a22-82b1-b1795e2e097a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Returning 404 to user: Instance c2bb023b-8f1e-4e58-969b-e6c56395acca could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:43:32.631843 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c868ab90-341d-4a22-82b1-b1795e2e097a tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca" status: 404 len: 111 microversion: 2.1 time: 0.029913 Sep 27 16:43:32.631843 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 487/924] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:32 2022] GET /compute/v2.1/servers/c2bb023b-8f1e-4e58-969b-e6c56395acca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:43:32.708313 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ef390ad3-48bf-44d0-9584-139079239aa2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:32.716613 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ef390ad3-48bf-44d0-9584-139079239aa2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1446 microversion: 2.1 time: 0.155923 Sep 27 16:43:32.717170 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 438/925] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:32 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1446 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:32.741363 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fdc37428-267d-4b17-8a29-29c74f267a94 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:32.742002 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fdc37428-267d-4b17-8a29-29c74f267a94 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:32.747977 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fdc37428-267d-4b17-8a29-29c74f267a94 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:32.748464 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fdc37428-267d-4b17-8a29-29c74f267a94 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:32.748902 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fdc37428-267d-4b17-8a29-29c74f267a94 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:32.752021 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fdc37428-267d-4b17-8a29-29c74f267a94 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:32.752021 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fdc37428-267d-4b17-8a29-29c74f267a94 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:32.752021 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fdc37428-267d-4b17-8a29-29c74f267a94 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:32.890638 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fdc37428-267d-4b17-8a29-29c74f267a94 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:32.899831 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fdc37428-267d-4b17-8a29-29c74f267a94 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1446 microversion: 2.1 time: 0.163270 Sep 27 16:43:32.900383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 488/926] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:32 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1446 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:33.921043 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-002d2eb3-81c6-4485-ae3e-045469310dfb tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:33.921550 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-002d2eb3-81c6-4485-ae3e-045469310dfb tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:33.928668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-002d2eb3-81c6-4485-ae3e-045469310dfb tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:33.929038 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-002d2eb3-81c6-4485-ae3e-045469310dfb tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:33.932371 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-002d2eb3-81c6-4485-ae3e-045469310dfb tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:33.932371 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-002d2eb3-81c6-4485-ae3e-045469310dfb tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:33.932371 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-002d2eb3-81c6-4485-ae3e-045469310dfb tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:33.932371 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-002d2eb3-81c6-4485-ae3e-045469310dfb tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:33.944148 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-002d2eb3-81c6-4485-ae3e-045469310dfb tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] HTTP exception thrown: Instance 8010c1e5-fe22-4255-a8df-0f63551bb226 could not be found. Sep 27 16:43:33.945685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-002d2eb3-81c6-4485-ae3e-045469310dfb tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Request method failure captured: Sep 27 16:43:33.945685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 HTTP/1.1 Sep 27 16:43:33.945685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:43:33.945685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:43:33.945685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:43:33.945685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 27 16:43:33.945685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:43:33.945685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:43:33.945685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:43:33.945685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:43:33.945685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMyaXt7kpD0PfNVvLYuBuVZ7HRidwt4V7Ad9Ym3_Vbex0YLxAbLBHGS-HGBld9NGzCqyRTvioGgsu3eg4VIjDtZIgTd01qZ6DSQMCZ0BknQO4xdhtqMgcyIwM-7CdV1bNe00wPntnIGZvSkxLDfg4QN7aDekfETC-lFwzlHlACFvCF14 Sep 27 16:43:33.945685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:43:33.945685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:43:33.945685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:43:33.945685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:43:33.945685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:43:33.945685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:43:33.945685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:43:33.945685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:33.945685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:43:33.945685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:43:33.947092 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_73fad530905b485cb7141793f6130a9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/73fad530905b485cb7141793f6130a9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:43:33.947092 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:33.947092 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:43:33.947092 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:33.947092 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:43:33.947092 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:43:33.947092 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:43:33.947092 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: e8d3af2b82b641aea11ebf79677a3af1 Sep 27 16:43:33.947092 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:43:33.947092 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: > Sep 27 16:43:33.947092 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Instance 8010c1e5-fe22-4255-a8df-0f63551bb226 could not be found. Sep 27 16:43:33.947092 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'id': '8010c1e5-fe22-4255-a8df-0f63551bb226'} Sep 27 16:43:33.947943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:43:33.947943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:33.947943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:43:33.947943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:43:33.947943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:43:33.947943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:43:33.947943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:43:33.947943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:43:33.947943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:43:33.947943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:43:33.947943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8010c1e5-fe22-4255-a8df-0f63551bb226 could not be found. Sep 27 16:43:33.947943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:43:33.947943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:43:33.947943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:43:33.947943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:33.947943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:43:33.947943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:43:33.947943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:43:33.947943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:43:33.947943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:43:33.949367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:43:33.949367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 16:43:33.949367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 16:43:33.949367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 16:43:33.949367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 16:43:33.949367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:43:33.949367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:43:33.949367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:43:33.949367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:43:33.949367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8010c1e5-fe22-4255-a8df-0f63551bb226 could not be found. Sep 27 16:43:33.949367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:43:33.949367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:43:33.949367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:43:33.949367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:33.949367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:43:33.949367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:43:33.949367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:43:33.949367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:43:33.949367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8010c1e5-fe22-4255-a8df-0f63551bb226 could not be found. Sep 27 16:43:33.949367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:43:33.951029 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-002d2eb3-81c6-4485-ae3e-045469310dfb tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Returning 404 to user: Instance 8010c1e5-fe22-4255-a8df-0f63551bb226 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:43:33.951029 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-002d2eb3-81c6-4485-ae3e-045469310dfb tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 404 len: 111 microversion: 2.1 time: 0.029827 Sep 27 16:43:33.951029 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 439/927] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:43:33 2022] DELETE /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:43:33.957315 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5ce317e8-c686-4e0c-9c7e-ddcf63bbdd76 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:33.965315 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5ce317e8-c686-4e0c-9c7e-ddcf63bbdd76 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] [instance: 8010c1e5-fe22-4255-a8df-0f63551bb226] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:33.965315 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ce317e8-c686-4e0c-9c7e-ddcf63bbdd76 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:33.965634 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ce317e8-c686-4e0c-9c7e-ddcf63bbdd76 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:33.966073 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ce317e8-c686-4e0c-9c7e-ddcf63bbdd76 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:33.966793 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ce317e8-c686-4e0c-9c7e-ddcf63bbdd76 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:33.967242 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ce317e8-c686-4e0c-9c7e-ddcf63bbdd76 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:33.967664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ce317e8-c686-4e0c-9c7e-ddcf63bbdd76 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:33.981995 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-5ce317e8-c686-4e0c-9c7e-ddcf63bbdd76 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] HTTP exception thrown: Instance 8010c1e5-fe22-4255-a8df-0f63551bb226 could not be found. Sep 27 16:43:33.983561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5ce317e8-c686-4e0c-9c7e-ddcf63bbdd76 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Request method failure captured: Sep 27 16:43:33.983561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 HTTP/1.1 Sep 27 16:43:33.983561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:43:33.983561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:43:33.983561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:43:33.983561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:43:33.983561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:43:33.983561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:43:33.983561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:43:33.983561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:43:33.983561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMyaXt7kpD0PfNVvLYuBuVZ7HRidwt4V7Ad9Ym3_Vbex0YLxAbLBHGS-HGBld9NGzCqyRTvioGgsu3eg4VIjDtZIgTd01qZ6DSQMCZ0BknQO4xdhtqMgcyIwM-7CdV1bNe00wPntnIGZvSkxLDfg4QN7aDekfETC-lFwzlHlACFvCF14 Sep 27 16:43:33.983561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:43:33.983561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:43:33.983561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:43:33.983561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:43:33.983561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:43:33.983561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:43:33.983561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:43:33.983561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:33.983561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:43:33.983561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:43:33.985155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_73fad530905b485cb7141793f6130a9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/73fad530905b485cb7141793f6130a9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/73fad530905b485cb7141793f6130a9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:43:33.985155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:33.985155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 73fad530905b485cb7141793f6130a9e Sep 27 16:43:33.985155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-145667287 Sep 27 16:43:33.985155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:43:33.985155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:43:33.985155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:43:33.985155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: e8d3af2b82b641aea11ebf79677a3af1 Sep 27 16:43:33.985155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeNegativeTest-145667287-project Sep 27 16:43:33.985155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:43:33.985155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Instance 8010c1e5-fe22-4255-a8df-0f63551bb226 could not be found. Sep 27 16:43:33.985155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': '8010c1e5-fe22-4255-a8df-0f63551bb226'} Sep 27 16:43:33.986036 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:43:33.986036 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:33.986036 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:43:33.986036 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:43:33.986036 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:43:33.986036 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:43:33.986036 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:43:33.986036 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:43:33.986036 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:43:33.986036 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:43:33.986036 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8010c1e5-fe22-4255-a8df-0f63551bb226 could not be found. Sep 27 16:43:33.986036 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:33.986036 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:43:33.986036 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:33.986036 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:33.986036 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:43:33.986036 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:43:33.986036 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:43:33.986036 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:43:33.986036 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:43:33.990864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:43:33.990864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:43:33.990864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:43:33.990864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:43:33.990864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:43:33.990864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:43:33.990864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:43:33.990864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8010c1e5-fe22-4255-a8df-0f63551bb226 could not be found. Sep 27 16:43:33.990864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:33.990864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:43:33.990864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:33.990864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:33.990864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:43:33.990864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:43:33.990864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:43:33.990864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:43:33.990864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8010c1e5-fe22-4255-a8df-0f63551bb226 could not be found. Sep 27 16:43:33.990864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:33.992448 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5ce317e8-c686-4e0c-9c7e-ddcf63bbdd76 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] Returning 404 to user: Instance 8010c1e5-fe22-4255-a8df-0f63551bb226 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:43:33.992448 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5ce317e8-c686-4e0c-9c7e-ddcf63bbdd76 tempest-AttachVolumeNegativeTest-145667287 tempest-AttachVolumeNegativeTest-145667287-project] 10.222.0.64 "GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226" status: 404 len: 111 microversion: 2.1 time: 0.032703 Sep 27 16:43:33.992448 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 489/928] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:43:33 2022] GET /compute/v2.1/servers/8010c1e5-fe22-4255-a8df-0f63551bb226 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:43:35.473994 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-17b15daa-9328-444c-97fd-59bf55256f35 req-ed030956-183a-43a1-9256-46418e07dd78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800233b1-cc79-4eb5-9cdf-ff21e8321268", "tag": "c6777043-34a8-4a48-b945-7f80df4e0022"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:43:35.485395 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-17b15daa-9328-444c-97fd-59bf55256f35 req-ed030956-183a-43a1-9256-46418e07dd78 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:35.486084 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-17b15daa-9328-444c-97fd-59bf55256f35 req-ed030956-183a-43a1-9256-46418e07dd78 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:35.486574 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-17b15daa-9328-444c-97fd-59bf55256f35 req-ed030956-183a-43a1-9256-46418e07dd78 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:35.498997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-17b15daa-9328-444c-97fd-59bf55256f35 req-ed030956-183a-43a1-9256-46418e07dd78 service nova] Creating event network-changed:c6777043-34a8-4a48-b945-7f80df4e0022 for instance 800233b1-cc79-4eb5-9cdf-ff21e8321268 on hv-cinder-85506 Sep 27 16:43:35.504042 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-17b15daa-9328-444c-97fd-59bf55256f35 req-ed030956-183a-43a1-9256-46418e07dd78 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033856 Sep 27 16:43:35.504932 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 440/929] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:43:39.516103 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-293e499a-f5d6-4267-8efc-65e02011b3f4 tempest-VolumesGetTestJSON-606211388 tempest-VolumesGetTestJSON-606211388-project] Action: 'create', calling method: .version_select at 0x7fa4059ddb80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1955829647", "metadata": {"Type": "work"}}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:43:40.301638 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-293e499a-f5d6-4267-8efc-65e02011b3f4 tempest-VolumesGetTestJSON-606211388 tempest-VolumesGetTestJSON-606211388-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.897040 Sep 27 16:43:40.302898 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 490/930] 10.222.0.64 () {60 vars in 1156 bytes} [Tue Sep 27 16:43:39 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 899 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 27 16:43:40.317312 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b4f8c4b1-94b0-4b87-9e75-5f38856867e9 tempest-VolumesGetTestJSON-606211388 tempest-VolumesGetTestJSON-606211388-project] Calling method '.version_select at 0x7fa405888c10>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:40.385086 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b4f8c4b1-94b0-4b87-9e75-5f38856867e9 tempest-VolumesGetTestJSON-606211388 tempest-VolumesGetTestJSON-606211388-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/04fa26ac-9958-44d8-94fc-bb93662320c6" status: 200 len: 353 microversion: 2.1 time: 0.072619 Sep 27 16:43:40.385930 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 441/931] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Sep 27 16:43:40 2022] GET /compute/v2.1/os-volumes/04fa26ac-9958-44d8-94fc-bb93662320c6 => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:43:41.405740 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-352ce3f1-21f9-4e9c-b533-1766f69add81 tempest-VolumesGetTestJSON-606211388 tempest-VolumesGetTestJSON-606211388-project] Calling method '.version_select at 0x7fa4090c3d30>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:41.452801 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-352ce3f1-21f9-4e9c-b533-1766f69add81 tempest-VolumesGetTestJSON-606211388 tempest-VolumesGetTestJSON-606211388-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/04fa26ac-9958-44d8-94fc-bb93662320c6" status: 200 len: 354 microversion: 2.1 time: 0.051139 Sep 27 16:43:41.453354 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 491/932] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Sep 27 16:43:41 2022] GET /compute/v2.1/os-volumes/04fa26ac-9958-44d8-94fc-bb93662320c6 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:43:41.467242 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-37e616f3-a298-4f24-b24b-3e728cb6b0b6 tempest-VolumesGetTestJSON-606211388 tempest-VolumesGetTestJSON-606211388-project] Calling method '.version_select at 0x7fa405748c10>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:41.513652 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-37e616f3-a298-4f24-b24b-3e728cb6b0b6 tempest-VolumesGetTestJSON-606211388 tempest-VolumesGetTestJSON-606211388-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/04fa26ac-9958-44d8-94fc-bb93662320c6" status: 200 len: 354 microversion: 2.1 time: 0.050840 Sep 27 16:43:41.514210 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 442/933] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Sep 27 16:43:41 2022] GET /compute/v2.1/os-volumes/04fa26ac-9958-44d8-94fc-bb93662320c6 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:43:41.532639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-69e9262f-8461-48c7-96d0-c6755438f657 tempest-VolumesGetTestJSON-606211388 tempest-VolumesGetTestJSON-606211388-project] Calling method '.version_select at 0x7fa409132160>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:41.805149 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-69e9262f-8461-48c7-96d0-c6755438f657 tempest-VolumesGetTestJSON-606211388 tempest-VolumesGetTestJSON-606211388-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/04fa26ac-9958-44d8-94fc-bb93662320c6" status: 202 len: 0 microversion: 2.1 time: 0.276499 Sep 27 16:43:41.805709 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 492/934] 10.222.0.64 () {58 vars in 1248 bytes} [Tue Sep 27 16:43:41 2022] DELETE /compute/v2.1/os-volumes/04fa26ac-9958-44d8-94fc-bb93662320c6 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:43:41.814365 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1bf88e21-81b5-4123-95ca-72732bbef50f tempest-VolumesGetTestJSON-606211388 tempest-VolumesGetTestJSON-606211388-project] Calling method '.version_select at 0x7fa405837c10>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:41.864434 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1bf88e21-81b5-4123-95ca-72732bbef50f tempest-VolumesGetTestJSON-606211388 tempest-VolumesGetTestJSON-606211388-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/04fa26ac-9958-44d8-94fc-bb93662320c6" status: 200 len: 353 microversion: 2.1 time: 0.054200 Sep 27 16:43:41.865467 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 443/935] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Sep 27 16:43:41 2022] GET /compute/v2.1/os-volumes/04fa26ac-9958-44d8-94fc-bb93662320c6 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:43:42.879501 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0c93f582-327c-4c57-a64f-b7a7c4314b83 tempest-VolumesGetTestJSON-606211388 tempest-VolumesGetTestJSON-606211388-project] Calling method '.version_select at 0x7fa405adfa60>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:42.907751 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-0c93f582-327c-4c57-a64f-b7a7c4314b83 tempest-VolumesGetTestJSON-606211388 tempest-VolumesGetTestJSON-606211388-project] HTTP exception thrown: Volume 04fa26ac-9958-44d8-94fc-bb93662320c6 could not be found. Sep 27 16:43:42.909745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0c93f582-327c-4c57-a64f-b7a7c4314b83 tempest-VolumesGetTestJSON-606211388 tempest-VolumesGetTestJSON-606211388-project] Request method failure captured: Sep 27 16:43:42.909745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/os-volumes/04fa26ac-9958-44d8-94fc-bb93662320c6 HTTP/1.1 Sep 27 16:43:42.909745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:43:42.909745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:43:42.909745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:43:42.909745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:43:42.909745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:43:42.909745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:43:42.909745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:43:42.909745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:43:42.909745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMyg70VhyXJ9BpCP36rYTSv_Y2ueNYdAQ0rXeDR4nfy0rcp5_hG6SFGBUeyNcuaXdEel8Us8-a3P1cejVNMfjbWEdp1rnyWTIyUc8fklWdT8nZsUj0VP7IcFXNjo6x7CQOy2_iTSRczog9I-rtfbJM28hfsQ8te53MsXqVzctv5m05W8 Sep 27 16:43:42.909745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:43:42.909745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:43:42.909745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:43:42.909745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:43:42.909745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:43:42.909745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:43:42.909745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 0f08b90b10444c318bcf8c5d4dce2bf6 Sep 27 16:43:42.909745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesGetTestJSON-606211388 Sep 27 16:43:42.909745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:43:42.909745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:43:42.911407 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0f08b90b10444c318bcf8c5d4dce2bf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0f08b90b10444c318bcf8c5d4dce2bf6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0f08b90b10444c318bcf8c5d4dce2bf6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0f08b90b10444c318bcf8c5d4dce2bf6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:43:42.911407 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesGetTestJSON-606211388 Sep 27 16:43:42.911407 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 0f08b90b10444c318bcf8c5d4dce2bf6 Sep 27 16:43:42.911407 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesGetTestJSON-606211388 Sep 27 16:43:42.911407 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesGetTestJSON-606211388-project Sep 27 16:43:42.911407 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:43:42.911407 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:43:42.911407 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: 95be235e9a4f41f8ba2df06b38f7e940 Sep 27 16:43:42.911407 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesGetTestJSON-606211388-project Sep 27 16:43:42.911407 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: Sep 27 16:43:42.911407 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Volume 04fa26ac-9958-44d8-94fc-bb93662320c6 could not be found. Sep 27 16:43:42.911407 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': '04fa26ac-9958-44d8-94fc-bb93662320c6'} Sep 27 16:43:42.911407 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:43:42.912357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:42.912357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 16:43:42.912357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 16:43:42.912357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 16:43:42.912357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 16:43:42.912357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 16:43:42.912357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 16:43:42.912357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 16:43:42.912357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 16:43:42.912357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 16:43:42.912357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 16:43:42.912357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 16:43:42.912357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 16:43:42.912357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 16:43:42.912357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 16:43:42.912357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 04fa26ac-9958-44d8-94fc-bb93662320c6 could not be found. (HTTP 404) (Request-ID: req-9eff29a7-36ce-4a5f-bfbe-3db382617e88) Sep 27 16:43:42.912357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:42.912357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:43:42.912357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:42.914163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:42.914163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 27 16:43:42.914163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 27 16:43:42.914163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 16:43:42.914163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 16:43:42.914163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 27 16:43:42.914163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 27 16:43:42.914163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 16:43:42.914163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 16:43:42.914163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 16:43:42.914163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 16:43:42.914163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 16:43:42.914163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 16:43:42.914163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 16:43:42.914163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 16:43:42.914163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 16:43:42.914163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 16:43:42.914163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 16:43:42.914163 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 16:43:42.915506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 16:43:42.915506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 16:43:42.915506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 16:43:42.915506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 16:43:42.915506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 04fa26ac-9958-44d8-94fc-bb93662320c6 could not be found. Sep 27 16:43:42.915506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:42.915506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:43:42.915506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:42.915506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:42.915506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:43:42.915506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:43:42.915506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:43:42.915506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:43:42.915506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 16:43:42.915506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 16:43:42.915506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:43:42.915506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:43:42.915506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 27 16:43:42.915506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:43:42.916879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 04fa26ac-9958-44d8-94fc-bb93662320c6 could not be found. Sep 27 16:43:42.916879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:42.916879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:43:42.916879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:42.916879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:42.916879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:43:42.916879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:43:42.916879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:43:42.916879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:43:42.916879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 04fa26ac-9958-44d8-94fc-bb93662320c6 could not be found. Sep 27 16:43:42.916879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:42.916879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0c93f582-327c-4c57-a64f-b7a7c4314b83 tempest-VolumesGetTestJSON-606211388 tempest-VolumesGetTestJSON-606211388-project] Returning 404 to user: Volume 04fa26ac-9958-44d8-94fc-bb93662320c6 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:43:42.916879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0c93f582-327c-4c57-a64f-b7a7c4314b83 tempest-VolumesGetTestJSON-606211388 tempest-VolumesGetTestJSON-606211388-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/04fa26ac-9958-44d8-94fc-bb93662320c6" status: 404 len: 109 microversion: 2.1 time: 0.035783 Sep 27 16:43:42.916879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 493/936] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Sep 27 16:43:42 2022] GET /compute/v2.1/os-volumes/04fa26ac-9958-44d8-94fc-bb93662320c6 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:43:53.914462 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:53.915831 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=78 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:53.919888 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c9436467-f3b9-40d2-96b7-47c73a116d8c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:53.922142 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c9436467-f3b9-40d2-96b7-47c73a116d8c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:53.928204 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9436467-f3b9-40d2-96b7-47c73a116d8c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:53.928777 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9436467-f3b9-40d2-96b7-47c73a116d8c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:53.929216 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9436467-f3b9-40d2-96b7-47c73a116d8c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:53.929909 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9436467-f3b9-40d2-96b7-47c73a116d8c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:53.930366 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9436467-f3b9-40d2-96b7-47c73a116d8c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:53.931572 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9436467-f3b9-40d2-96b7-47c73a116d8c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:53.960508 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c9436467-f3b9-40d2-96b7-47c73a116d8c tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047458 Sep 27 16:43:53.961061 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 444/937] 10.222.0.64 () {60 vars in 1343 bytes} [Tue Sep 27 16:43:53 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:43:54.020598 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:54.021344 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=27 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:43:54.025458 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-045e4bea-411b-4ad0-87f4-f8321ad2783e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:54.025952 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-045e4bea-411b-4ad0-87f4-f8321ad2783e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:54.032657 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-045e4bea-411b-4ad0-87f4-f8321ad2783e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:54.033143 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-045e4bea-411b-4ad0-87f4-f8321ad2783e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:54.033578 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-045e4bea-411b-4ad0-87f4-f8321ad2783e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:54.034264 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-045e4bea-411b-4ad0-87f4-f8321ad2783e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:54.034720 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-045e4bea-411b-4ad0-87f4-f8321ad2783e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:54.035171 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-045e4bea-411b-4ad0-87f4-f8321ad2783e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:54.060616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-045e4bea-411b-4ad0-87f4-f8321ad2783e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 16:43:54.374140 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-045e4bea-411b-4ad0-87f4-f8321ad2783e tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "DELETE /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 204 len: 0 microversion: 2.20 time: 0.354076 Sep 27 16:43:54.374759 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 494/938] 10.222.0.64 () {60 vars in 1280 bytes} [Tue Sep 27 16:43:54 2022] DELETE /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 16:43:54.383632 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4db457b2-0f50-4ba7-bf04-de8a60b779e1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:54.384476 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4db457b2-0f50-4ba7-bf04-de8a60b779e1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:54.391280 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4db457b2-0f50-4ba7-bf04-de8a60b779e1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:54.391758 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4db457b2-0f50-4ba7-bf04-de8a60b779e1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:54.392187 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4db457b2-0f50-4ba7-bf04-de8a60b779e1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:54.392863 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4db457b2-0f50-4ba7-bf04-de8a60b779e1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:54.393335 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4db457b2-0f50-4ba7-bf04-de8a60b779e1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:54.393750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4db457b2-0f50-4ba7-bf04-de8a60b779e1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:54.525924 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4db457b2-0f50-4ba7-bf04-de8a60b779e1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:54.534711 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4db457b2-0f50-4ba7-bf04-de8a60b779e1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:54.536229 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4db457b2-0f50-4ba7-bf04-de8a60b779e1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:54.537394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4db457b2-0f50-4ba7-bf04-de8a60b779e1 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1724 microversion: 2.20 time: 0.158053 Sep 27 16:43:54.538051 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 445/939] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:43:54 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:43:55.564261 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-186a637c-6d16-46c9-8d29-df474e9e725d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:55.564906 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-186a637c-6d16-46c9-8d29-df474e9e725d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:55.570844 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-186a637c-6d16-46c9-8d29-df474e9e725d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:55.571427 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-186a637c-6d16-46c9-8d29-df474e9e725d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:55.571774 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-186a637c-6d16-46c9-8d29-df474e9e725d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:55.572471 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-186a637c-6d16-46c9-8d29-df474e9e725d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:55.572923 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-186a637c-6d16-46c9-8d29-df474e9e725d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:55.573344 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-186a637c-6d16-46c9-8d29-df474e9e725d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:55.716664 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-186a637c-6d16-46c9-8d29-df474e9e725d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:55.724862 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-186a637c-6d16-46c9-8d29-df474e9e725d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:55.726307 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-186a637c-6d16-46c9-8d29-df474e9e725d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:55.728216 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-186a637c-6d16-46c9-8d29-df474e9e725d tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1724 microversion: 2.20 time: 0.167696 Sep 27 16:43:55.728880 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 495/940] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:43:55 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:43:56.754523 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7025bc52-2092-4813-b3ef-25f9f4b47df7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:56.755826 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7025bc52-2092-4813-b3ef-25f9f4b47df7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:56.764736 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7025bc52-2092-4813-b3ef-25f9f4b47df7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:56.767018 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7025bc52-2092-4813-b3ef-25f9f4b47df7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:56.767466 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7025bc52-2092-4813-b3ef-25f9f4b47df7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:56.768179 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7025bc52-2092-4813-b3ef-25f9f4b47df7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:56.769573 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7025bc52-2092-4813-b3ef-25f9f4b47df7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:56.769996 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7025bc52-2092-4813-b3ef-25f9f4b47df7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:56.849317 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7025bc52-2092-4813-b3ef-25f9f4b47df7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:56.858514 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7025bc52-2092-4813-b3ef-25f9f4b47df7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:56.860005 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7025bc52-2092-4813-b3ef-25f9f4b47df7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:56.861169 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7025bc52-2092-4813-b3ef-25f9f4b47df7 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1657 microversion: 2.20 time: 0.110596 Sep 27 16:43:56.865712 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 446/941] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:43:56 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1657 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:43:57.112943 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-23172580-73c3-4c93-bd53-95200b7981a5 req-fb0664aa-6cae-44c1-aca3-cc2807992f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac", "name": "network-vif-deleted", "tag": "ddb6a707-22f0-4c10-adcc-9f4d5d262645"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:43:57.127139 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-23172580-73c3-4c93-bd53-95200b7981a5 req-fb0664aa-6cae-44c1-aca3-cc2807992f60 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:57.127962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-23172580-73c3-4c93-bd53-95200b7981a5 req-fb0664aa-6cae-44c1-aca3-cc2807992f60 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:57.128240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-23172580-73c3-4c93-bd53-95200b7981a5 req-fb0664aa-6cae-44c1-aca3-cc2807992f60 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:57.141101 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-23172580-73c3-4c93-bd53-95200b7981a5 req-fb0664aa-6cae-44c1-aca3-cc2807992f60 service nova] Creating event network-vif-deleted:ddb6a707-22f0-4c10-adcc-9f4d5d262645 for instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac on hv-cinder-85506 Sep 27 16:43:57.156316 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-23172580-73c3-4c93-bd53-95200b7981a5 req-fb0664aa-6cae-44c1-aca3-cc2807992f60 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039285 Sep 27 16:43:57.156316 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 496/942] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:43:57.894759 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-10924537-b282-4c93-a189-1f178f7df24f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:57.895318 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-10924537-b282-4c93-a189-1f178f7df24f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:57.904490 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10924537-b282-4c93-a189-1f178f7df24f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:57.905070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10924537-b282-4c93-a189-1f178f7df24f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:57.905417 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10924537-b282-4c93-a189-1f178f7df24f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:57.906453 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10924537-b282-4c93-a189-1f178f7df24f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:57.906639 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10924537-b282-4c93-a189-1f178f7df24f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:57.907101 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10924537-b282-4c93-a189-1f178f7df24f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:57.943581 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10924537-b282-4c93-a189-1f178f7df24f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:57.944071 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10924537-b282-4c93-a189-1f178f7df24f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:57.944717 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10924537-b282-4c93-a189-1f178f7df24f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:57.945557 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-10924537-b282-4c93-a189-1f178f7df24f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lazy-loading 'fault' on Instance uuid 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:43:57.990696 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-10924537-b282-4c93-a189-1f178f7df24f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:57.999644 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-10924537-b282-4c93-a189-1f178f7df24f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:58.001076 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-10924537-b282-4c93-a189-1f178f7df24f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dbfb1a3e99c418098c2b02aea93b923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cca09950c34cc7baded0eb0a42bb07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:43:58.002221 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-10924537-b282-4c93-a189-1f178f7df24f tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 200 len: 1372 microversion: 2.20 time: 0.111546 Sep 27 16:43:58.002854 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 447/943] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:43:57 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 1372 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 16:43:59.028318 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4ca39d3e-9a9f-4c68-bb8d-33a0f8d93a9a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:59.029234 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4ca39d3e-9a9f-4c68-bb8d-33a0f8d93a9a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:43:59.036160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ca39d3e-9a9f-4c68-bb8d-33a0f8d93a9a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:59.036738 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ca39d3e-9a9f-4c68-bb8d-33a0f8d93a9a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:59.037082 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ca39d3e-9a9f-4c68-bb8d-33a0f8d93a9a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:59.037770 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ca39d3e-9a9f-4c68-bb8d-33a0f8d93a9a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:43:59.038230 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ca39d3e-9a9f-4c68-bb8d-33a0f8d93a9a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:43:59.038643 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ca39d3e-9a9f-4c68-bb8d-33a0f8d93a9a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:43:59.052614 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-4ca39d3e-9a9f-4c68-bb8d-33a0f8d93a9a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] HTTP exception thrown: Instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac could not be found. Sep 27 16:43:59.054240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4ca39d3e-9a9f-4c68-bb8d-33a0f8d93a9a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Request method failure captured: Sep 27 16:43:59.054240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac HTTP/1.1 Sep 27 16:43:59.054240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:43:59.054240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:43:59.054240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:43:59.054240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:43:59.054240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:43:59.054240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:43:59.054240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:43:59.054240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:43:59.054240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMyaWfTwBhIv8VoCuCi39_gxY9i4xSwqXg0VrZruLd6f3-bRzY6-ACesCZRa0ZexfyVrHnrBnUchfcy1jlih-TbjFX0crQ_L9uQk_Lo0mx0-lna7pK5N1zbzzZb0_G8C37IPZNpeHs6gmTjI_mB-uRDlJczN3eF0mNXxDjrmVclKRRQM Sep 27 16:43:59.054240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:43:59.054240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:43:59.054240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:43:59.054240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:43:59.054240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Openstack-Nova-Api-Version: 2.20 Sep 27 16:43:59.054240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:43:59.054240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:43:59.054240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 41cca09950c34cc7baded0eb0a42bb07 Sep 27 16:43:59.054240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-480632448 Sep 27 16:43:59.054240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:43:59.054240 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:43:59.056763 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:43:59.056763 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeShelveTestJSON-480632448 Sep 27 16:43:59.056763 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 41cca09950c34cc7baded0eb0a42bb07 Sep 27 16:43:59.056763 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-480632448 Sep 27 16:43:59.056763 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeShelveTestJSON-480632448-project Sep 27 16:43:59.056763 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:43:59.056763 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:43:59.056763 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: 1dbfb1a3e99c418098c2b02aea93b923 Sep 27 16:43:59.056763 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeShelveTestJSON-480632448-project Sep 27 16:43:59.056763 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:43:59.056763 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac could not be found. Sep 27 16:43:59.056763 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': '50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac'} Sep 27 16:43:59.057649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:43:59.057649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:59.057649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:43:59.057649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:43:59.057649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:43:59.057649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:43:59.057649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:43:59.057649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:43:59.057649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:43:59.057649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:43:59.057649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac could not be found. Sep 27 16:43:59.057649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:59.057649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:43:59.057649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:59.057649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:59.057649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:43:59.057649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:43:59.057649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:43:59.057649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:43:59.057649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:43:59.059282 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:43:59.059282 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:43:59.059282 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:43:59.059282 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:43:59.059282 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:43:59.059282 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:43:59.059282 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:43:59.059282 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac could not be found. Sep 27 16:43:59.059282 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:59.059282 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:43:59.059282 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:59.059282 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:43:59.059282 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:43:59.059282 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:43:59.059282 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:43:59.059282 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:43:59.059282 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac could not be found. Sep 27 16:43:59.059282 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:43:59.060662 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4ca39d3e-9a9f-4c68-bb8d-33a0f8d93a9a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Returning 404 to user: Instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:43:59.060662 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4ca39d3e-9a9f-4c68-bb8d-33a0f8d93a9a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 404 len: 111 microversion: 2.20 time: 0.031844 Sep 27 16:43:59.060662 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 497/944] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:43:59 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 16:43:59.069909 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1cd8aa99-3ee1-439b-8fa3-8d1e422826c6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '.version_select at 0x7fa405898430>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:43:59.180305 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1cd8aa99-3ee1-439b-8fa3-8d1e422826c6 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2068111148" status: 204 len: 0 microversion: 2.20 time: 0.114424 Sep 27 16:43:59.181717 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 448/945] 10.222.0.64 () {60 vars in 1262 bytes} [Tue Sep 27 16:43:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2068111148 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 16:44:01.319014 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7142ab2e-9883-48f2-9a74-acb0c3cc363a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:44:01.319542 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7142ab2e-9883-48f2-9a74-acb0c3cc363a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:44:01.326209 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7142ab2e-9883-48f2-9a74-acb0c3cc363a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:01.326693 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7142ab2e-9883-48f2-9a74-acb0c3cc363a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:01.327174 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7142ab2e-9883-48f2-9a74-acb0c3cc363a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:01.327923 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7142ab2e-9883-48f2-9a74-acb0c3cc363a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:01.328376 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7142ab2e-9883-48f2-9a74-acb0c3cc363a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:01.328798 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7142ab2e-9883-48f2-9a74-acb0c3cc363a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:01.343421 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-7142ab2e-9883-48f2-9a74-acb0c3cc363a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] HTTP exception thrown: Instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac could not be found. Sep 27 16:44:01.344969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7142ab2e-9883-48f2-9a74-acb0c3cc363a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Request method failure captured: Sep 27 16:44:01.344969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: DELETE /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac HTTP/1.1 Sep 27 16:44:01.344969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:44:01.344969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:44:01.344969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:44:01.344969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:44:01.344969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:44:01.344969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:44:01.344969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:44:01.344969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:44:01.344969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMyaWfTwBhIv8VoCuCi39_gxY9i4xSwqXg0VrZruLd6f3-bRzY6-ACesCZRa0ZexfyVrHnrBnUchfcy1jlih-TbjFX0crQ_L9uQk_Lo0mx0-lna7pK5N1zbzzZb0_G8C37IPZNpeHs6gmTjI_mB-uRDlJczN3eF0mNXxDjrmVclKRRQM Sep 27 16:44:01.344969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:44:01.344969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:44:01.344969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:44:01.344969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:44:01.344969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Openstack-Nova-Api-Version: 2.20 Sep 27 16:44:01.344969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:44:01.344969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:44:01.344969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 41cca09950c34cc7baded0eb0a42bb07 Sep 27 16:44:01.344969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-480632448 Sep 27 16:44:01.344969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:44:01.344969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:44:01.346544 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:44:01.346544 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeShelveTestJSON-480632448 Sep 27 16:44:01.346544 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 41cca09950c34cc7baded0eb0a42bb07 Sep 27 16:44:01.346544 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-480632448 Sep 27 16:44:01.346544 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeShelveTestJSON-480632448-project Sep 27 16:44:01.346544 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:44:01.346544 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:44:01.346544 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: 1dbfb1a3e99c418098c2b02aea93b923 Sep 27 16:44:01.346544 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeShelveTestJSON-480632448-project Sep 27 16:44:01.346544 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:44:01.346544 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac could not be found. Sep 27 16:44:01.346544 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': '50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac'} Sep 27 16:44:01.347386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:44:01.347386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:44:01.347386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:44:01.347386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:44:01.347386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:44:01.347386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:44:01.347386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:44:01.347386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:44:01.347386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:44:01.347386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:44:01.347386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac could not be found. Sep 27 16:44:01.347386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:44:01.347386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:44:01.347386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:44:01.347386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:44:01.347386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:44:01.347386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:44:01.347386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:44:01.347386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:44:01.347386 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:44:01.348806 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:44:01.348806 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 16:44:01.348806 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 16:44:01.348806 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 16:44:01.348806 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 16:44:01.348806 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:44:01.348806 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:44:01.348806 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:44:01.348806 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:44:01.348806 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac could not be found. Sep 27 16:44:01.348806 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:44:01.348806 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:44:01.348806 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:44:01.348806 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:44:01.348806 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:44:01.348806 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:44:01.348806 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:44:01.348806 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:44:01.348806 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac could not be found. Sep 27 16:44:01.348806 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:44:01.350595 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7142ab2e-9883-48f2-9a74-acb0c3cc363a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Returning 404 to user: Instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:44:01.350595 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7142ab2e-9883-48f2-9a74-acb0c3cc363a tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "DELETE /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 404 len: 111 microversion: 2.20 time: 0.031360 Sep 27 16:44:01.350595 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 498/946] 10.222.0.64 () {60 vars in 1280 bytes} [Tue Sep 27 16:44:01 2022] DELETE /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 16:44:01.355375 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3ed3da26-7916-4479-857e-773067461dd0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:44:01.358678 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3ed3da26-7916-4479-857e-773067461dd0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:44:01.363077 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ed3da26-7916-4479-857e-773067461dd0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:01.363562 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ed3da26-7916-4479-857e-773067461dd0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:01.364001 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ed3da26-7916-4479-857e-773067461dd0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:01.364699 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ed3da26-7916-4479-857e-773067461dd0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:01.365155 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ed3da26-7916-4479-857e-773067461dd0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:01.365603 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3ed3da26-7916-4479-857e-773067461dd0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:01.380971 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-3ed3da26-7916-4479-857e-773067461dd0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] HTTP exception thrown: Instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac could not be found. Sep 27 16:44:01.382724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3ed3da26-7916-4479-857e-773067461dd0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Request method failure captured: Sep 27 16:44:01.382724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac HTTP/1.1 Sep 27 16:44:01.382724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:44:01.382724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:44:01.382724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:44:01.382724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 27 16:44:01.382724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:44:01.382724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:44:01.382724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:44:01.382724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:44:01.382724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMyaWfTwBhIv8VoCuCi39_gxY9i4xSwqXg0VrZruLd6f3-bRzY6-ACesCZRa0ZexfyVrHnrBnUchfcy1jlih-TbjFX0crQ_L9uQk_Lo0mx0-lna7pK5N1zbzzZb0_G8C37IPZNpeHs6gmTjI_mB-uRDlJczN3eF0mNXxDjrmVclKRRQM Sep 27 16:44:01.382724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:44:01.382724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:44:01.382724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:44:01.382724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:44:01.382724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Openstack-Nova-Api-Version: 2.20 Sep 27 16:44:01.382724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:44:01.382724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:44:01.382724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: 41cca09950c34cc7baded0eb0a42bb07 Sep 27 16:44:01.382724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-480632448 Sep 27 16:44:01.382724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:44:01.382724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:44:01.388912 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:44:01.388912 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeShelveTestJSON-480632448 Sep 27 16:44:01.388912 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 41cca09950c34cc7baded0eb0a42bb07 Sep 27 16:44:01.388912 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-480632448 Sep 27 16:44:01.388912 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeShelveTestJSON-480632448-project Sep 27 16:44:01.388912 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:44:01.388912 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:44:01.388912 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: 1dbfb1a3e99c418098c2b02aea93b923 Sep 27 16:44:01.388912 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeShelveTestJSON-480632448-project Sep 27 16:44:01.388912 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: > Sep 27 16:44:01.388912 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac could not be found. Sep 27 16:44:01.388912 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'id': '50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac'} Sep 27 16:44:01.389851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:44:01.389851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:44:01.389851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:44:01.389851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:44:01.389851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:44:01.389851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:44:01.389851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:44:01.389851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:44:01.389851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:44:01.389851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:44:01.389851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac could not be found. Sep 27 16:44:01.389851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:44:01.389851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:44:01.389851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:44:01.389851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:44:01.389851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:44:01.389851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:44:01.389851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:44:01.389851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:44:01.389851 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:44:01.391833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:44:01.391833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:44:01.391833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:44:01.391833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:44:01.391833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:44:01.391833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:44:01.391833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:44:01.391833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac could not be found. Sep 27 16:44:01.391833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:44:01.391833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:44:01.391833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:44:01.391833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:44:01.391833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:44:01.391833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:44:01.391833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:44:01.391833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:44:01.391833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac could not be found. Sep 27 16:44:01.391833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:44:01.393179 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3ed3da26-7916-4479-857e-773067461dd0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Returning 404 to user: Instance 50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:44:01.393179 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3ed3da26-7916-4479-857e-773067461dd0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac" status: 404 len: 111 microversion: 2.20 time: 0.033563 Sep 27 16:44:01.393179 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 449/947] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:44:01 2022] GET /compute/v2.1/servers/50ff2adc-e5d7-47cf-83d0-a7ae0cf2baac => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 16:44:02.739548 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-783b3c9b-dd17-4c4b-9d19-12a06b3f13d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:44:02.739548 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-783b3c9b-dd17-4c4b-9d19-12a06b3f13d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:44:02.739548 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-783b3c9b-dd17-4c4b-9d19-12a06b3f13d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:02.739548 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-783b3c9b-dd17-4c4b-9d19-12a06b3f13d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:02.740332 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-783b3c9b-dd17-4c4b-9d19-12a06b3f13d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:02.740332 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-783b3c9b-dd17-4c4b-9d19-12a06b3f13d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:02.740332 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-783b3c9b-dd17-4c4b-9d19-12a06b3f13d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:02.740332 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-783b3c9b-dd17-4c4b-9d19-12a06b3f13d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:02.740675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-783b3c9b-dd17-4c4b-9d19-12a06b3f13d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] HTTP exception thrown: Instance f84acf37-9445-48cd-a921-12a7a3c301d9 could not be found. Sep 27 16:44:02.740675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-783b3c9b-dd17-4c4b-9d19-12a06b3f13d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Request method failure captured: Sep 27 16:44:02.740675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: DELETE /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 HTTP/1.1 Sep 27 16:44:02.740675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:44:02.740675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:44:02.740675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:44:02.740675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:44:02.740675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:44:02.740675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:44:02.740675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:44:02.740675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:44:02.740675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMyaWfTwBhIv8VoCuCi39_gxY9i4xSwqXg0VrZruLd6f3-bRzY6-ACesCZRa0ZexfyVrHnrBnUchfcy1jlih-TbjFX0crQ_L9uQk_Lo0mx0-lna7pK5N1zbzzZb0_G8C37IPZNpeHs6gmTjI_mB-uRDlJczN3eF0mNXxDjrmVclKRRQM Sep 27 16:44:02.740675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:44:02.740675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:44:02.740675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:44:02.740675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:44:02.740675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Openstack-Nova-Api-Version: 2.20 Sep 27 16:44:02.740675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:44:02.740675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:44:02.740675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 41cca09950c34cc7baded0eb0a42bb07 Sep 27 16:44:02.740675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-480632448 Sep 27 16:44:02.740675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:44:02.740675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:44:02.742393 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:44:02.742393 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeShelveTestJSON-480632448 Sep 27 16:44:02.742393 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 41cca09950c34cc7baded0eb0a42bb07 Sep 27 16:44:02.742393 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-480632448 Sep 27 16:44:02.742393 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeShelveTestJSON-480632448-project Sep 27 16:44:02.742393 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:44:02.742393 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:44:02.742393 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: 1dbfb1a3e99c418098c2b02aea93b923 Sep 27 16:44:02.742393 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeShelveTestJSON-480632448-project Sep 27 16:44:02.742393 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:44:02.742393 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Instance f84acf37-9445-48cd-a921-12a7a3c301d9 could not be found. Sep 27 16:44:02.742393 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': 'f84acf37-9445-48cd-a921-12a7a3c301d9'} Sep 27 16:44:02.743340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:44:02.743340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:44:02.743340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:44:02.743340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:44:02.743340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:44:02.743340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:44:02.743340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:44:02.743340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:44:02.743340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:44:02.743340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:44:02.743340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f84acf37-9445-48cd-a921-12a7a3c301d9 could not be found. Sep 27 16:44:02.743340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:44:02.743340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:44:02.743340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:44:02.743340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:44:02.743340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:44:02.743340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:44:02.743340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:44:02.743340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:44:02.743340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:44:02.744920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:44:02.744920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 16:44:02.744920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 16:44:02.744920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 16:44:02.744920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 16:44:02.744920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:44:02.744920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:44:02.744920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:44:02.744920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:44:02.744920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f84acf37-9445-48cd-a921-12a7a3c301d9 could not be found. Sep 27 16:44:02.744920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:44:02.744920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:44:02.744920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:44:02.744920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:44:02.744920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:44:02.744920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:44:02.744920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:44:02.744920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:44:02.744920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f84acf37-9445-48cd-a921-12a7a3c301d9 could not be found. Sep 27 16:44:02.744920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:44:02.746541 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-783b3c9b-dd17-4c4b-9d19-12a06b3f13d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Returning 404 to user: Instance f84acf37-9445-48cd-a921-12a7a3c301d9 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:44:02.746541 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-783b3c9b-dd17-4c4b-9d19-12a06b3f13d0 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 404 len: 111 microversion: 2.20 time: 0.029858 Sep 27 16:44:02.746541 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 499/948] 10.222.0.64 () {60 vars in 1280 bytes} [Tue Sep 27 16:44:02 2022] DELETE /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 16:44:02.746853 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-98486b6e-f8b2-408a-a97a-6bc009aec899 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:44:02.746853 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-98486b6e-f8b2-408a-a97a-6bc009aec899 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] [instance: f84acf37-9445-48cd-a921-12a7a3c301d9] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:44:02.746853 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98486b6e-f8b2-408a-a97a-6bc009aec899 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:02.746853 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98486b6e-f8b2-408a-a97a-6bc009aec899 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:02.747483 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98486b6e-f8b2-408a-a97a-6bc009aec899 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:02.747483 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98486b6e-f8b2-408a-a97a-6bc009aec899 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:02.747483 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98486b6e-f8b2-408a-a97a-6bc009aec899 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:02.747483 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98486b6e-f8b2-408a-a97a-6bc009aec899 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:02.761034 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-98486b6e-f8b2-408a-a97a-6bc009aec899 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] HTTP exception thrown: Instance f84acf37-9445-48cd-a921-12a7a3c301d9 could not be found. Sep 27 16:44:02.762565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-98486b6e-f8b2-408a-a97a-6bc009aec899 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Request method failure captured: Sep 27 16:44:02.762565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 HTTP/1.1 Sep 27 16:44:02.762565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:44:02.762565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:44:02.762565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:44:02.762565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 27 16:44:02.762565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:44:02.762565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:44:02.762565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:44:02.762565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:44:02.762565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMyaWfTwBhIv8VoCuCi39_gxY9i4xSwqXg0VrZruLd6f3-bRzY6-ACesCZRa0ZexfyVrHnrBnUchfcy1jlih-TbjFX0crQ_L9uQk_Lo0mx0-lna7pK5N1zbzzZb0_G8C37IPZNpeHs6gmTjI_mB-uRDlJczN3eF0mNXxDjrmVclKRRQM Sep 27 16:44:02.762565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:44:02.762565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:44:02.762565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:44:02.762565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:44:02.762565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Openstack-Nova-Api-Version: 2.20 Sep 27 16:44:02.762565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:44:02.762565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:44:02.762565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: 41cca09950c34cc7baded0eb0a42bb07 Sep 27 16:44:02.762565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-480632448 Sep 27 16:44:02.762565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:44:02.762565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:44:02.770857 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/41cca09950c34cc7baded0eb0a42bb07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:44:02.770857 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeShelveTestJSON-480632448 Sep 27 16:44:02.770857 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 41cca09950c34cc7baded0eb0a42bb07 Sep 27 16:44:02.770857 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-480632448 Sep 27 16:44:02.770857 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeShelveTestJSON-480632448-project Sep 27 16:44:02.770857 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:44:02.770857 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:44:02.770857 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: 1dbfb1a3e99c418098c2b02aea93b923 Sep 27 16:44:02.770857 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeShelveTestJSON-480632448-project Sep 27 16:44:02.770857 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: > Sep 27 16:44:02.770857 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Instance f84acf37-9445-48cd-a921-12a7a3c301d9 could not be found. Sep 27 16:44:02.770857 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'id': 'f84acf37-9445-48cd-a921-12a7a3c301d9'} Sep 27 16:44:02.772358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:44:02.772358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:44:02.772358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:44:02.772358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:44:02.772358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:44:02.772358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:44:02.772358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:44:02.772358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:44:02.772358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:44:02.772358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:44:02.772358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f84acf37-9445-48cd-a921-12a7a3c301d9 could not be found. Sep 27 16:44:02.772358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:44:02.772358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:44:02.772358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:44:02.772358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:44:02.772358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:44:02.772358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:44:02.772358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:44:02.772358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:44:02.772358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:44:02.774902 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:44:02.774902 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:44:02.774902 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:44:02.774902 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:44:02.774902 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:44:02.774902 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:44:02.774902 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:44:02.774902 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f84acf37-9445-48cd-a921-12a7a3c301d9 could not be found. Sep 27 16:44:02.774902 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:44:02.774902 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:44:02.774902 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:44:02.774902 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:44:02.774902 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:44:02.774902 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:44:02.774902 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:44:02.774902 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:44:02.774902 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f84acf37-9445-48cd-a921-12a7a3c301d9 could not be found. Sep 27 16:44:02.774902 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:44:02.778282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-98486b6e-f8b2-408a-a97a-6bc009aec899 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] Returning 404 to user: Instance f84acf37-9445-48cd-a921-12a7a3c301d9 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:44:02.778282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-98486b6e-f8b2-408a-a97a-6bc009aec899 tempest-AttachVolumeShelveTestJSON-480632448 tempest-AttachVolumeShelveTestJSON-480632448-project] 10.222.0.64 "GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9" status: 404 len: 111 microversion: 2.20 time: 0.030949 Sep 27 16:44:02.778282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 450/949] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Sep 27 16:44:02 2022] GET /compute/v2.1/servers/f84acf37-9445-48cd-a921-12a7a3c301d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 16:44:14.537995 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:14.538740 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:14.657740 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a7933a68-f8d8-4e65-83fc-e61acfa48a7d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Action: 'create', calling method: .version_select at 0x7fa409132310>, body: {"keypair": {"name": "tempest-keypair-8737856", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPW4c1aYMoldVOJWJZ/N+ij49bczcLDA1Beo0m8AD4/83/EvzKl6jCSbD2zZzEAKRCfK/uAg/IvQY/WKFcN3gZTe9GnA7l3qejHPujwNGHlX/8vLolHj+qCIqe6jZKG+EA=="}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:44:14.677104 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-a7933a68-f8d8-4e65-83fc-e61acfa48a7d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Getting quotas for project 0a89110c26344f608dae59f5616575f3. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:44:14.682919 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-a7933a68-f8d8-4e65-83fc-e61acfa48a7d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Getting quotas for user 09cb0d1d7888436dae18a45598a8c82a and project 0a89110c26344f608dae59f5616575f3. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:44:14.814082 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a7933a68-f8d8-4e65-83fc-e61acfa48a7d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.280258 Sep 27 16:44:14.814745 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 500/950] 10.222.0.64 () {60 vars in 1159 bytes} [Tue Sep 27 16:44:14 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:44:17.120678 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-77379c0d-7606-440d-8376-5e97ea761dff tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1300010788", "imageRef": "6908a343-46fa-4801-bfb5-7ad92ac26956", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6f6f055-03fc-4efc-8706-3ef9e91b6fee"}], "security_groups": [{"name": "tempest-securitygroup--679019550"}], "key_name": "tempest-keypair-8737856", "user_data": "}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:44:17.130673 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:17.131894 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=30 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:17.259313 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-77379c0d-7606-440d-8376-5e97ea761dff tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] validate_networks() for [('c6f6f055-03fc-4efc-8706-3ef9e91b6fee', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 16:44:17.748936 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-77379c0d-7606-440d-8376-5e97ea761dff tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 16:44:17.749294 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-77379c0d-7606-440d-8376-5e97ea761dff tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 16:44:17.749793 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-77379c0d-7606-440d-8376-5e97ea761dff tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 16:44:17.750193 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-77379c0d-7606-440d-8376-5e97ea761dff tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 16:44:17.750596 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-77379c0d-7606-440d-8376-5e97ea761dff tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 16:44:17.759980 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77379c0d-7606-440d-8376-5e97ea761dff tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:17.760464 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77379c0d-7606-440d-8376-5e97ea761dff tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:17.760892 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77379c0d-7606-440d-8376-5e97ea761dff tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:17.761617 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77379c0d-7606-440d-8376-5e97ea761dff tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:17.762118 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77379c0d-7606-440d-8376-5e97ea761dff tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:17.762498 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77379c0d-7606-440d-8376-5e97ea761dff tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:17.782576 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-77379c0d-7606-440d-8376-5e97ea761dff tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Getting quotas for project 0a89110c26344f608dae59f5616575f3. Resources: {'instances', 'ram', 'cores'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:44:17.787949 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-77379c0d-7606-440d-8376-5e97ea761dff tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Getting quotas for user 09cb0d1d7888436dae18a45598a8c82a and project 0a89110c26344f608dae59f5616575f3. Resources: {'instances', 'ram', 'cores'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:44:17.807755 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-77379c0d-7606-440d-8376-5e97ea761dff tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 16:44:17.810658 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-77379c0d-7606-440d-8376-5e97ea761dff tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6908a343-46fa-4801-bfb5-7ad92ac26956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 16:44:17.971427 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-77379c0d-7606-440d-8376-5e97ea761dff tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.854462 Sep 27 16:44:17.972208 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 451/951] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Sep 27 16:44:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 16:44:17.984428 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-08c0409a-9663-40a5-a844-7f8e98a8425d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:44:17.987502 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-08c0409a-9663-40a5-a844-7f8e98a8425d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:44:18.059823 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-08c0409a-9663-40a5-a844-7f8e98a8425d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:44:18.067833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-08c0409a-9663-40a5-a844-7f8e98a8425d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1235 microversion: 2.1 time: 0.088061 Sep 27 16:44:18.068898 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 501/952] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:44:17 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1235 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:44:19.092525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e90095f3-fa09-4103-82b0-19e22417a354 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:44:19.093134 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e90095f3-fa09-4103-82b0-19e22417a354 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:44:19.099077 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e90095f3-fa09-4103-82b0-19e22417a354 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:19.099557 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e90095f3-fa09-4103-82b0-19e22417a354 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:19.099985 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e90095f3-fa09-4103-82b0-19e22417a354 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:19.100716 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e90095f3-fa09-4103-82b0-19e22417a354 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:19.101166 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e90095f3-fa09-4103-82b0-19e22417a354 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:19.101585 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e90095f3-fa09-4103-82b0-19e22417a354 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:19.163606 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e90095f3-fa09-4103-82b0-19e22417a354 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:44:19.172251 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e90095f3-fa09-4103-82b0-19e22417a354 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1239 microversion: 2.1 time: 0.084855 Sep 27 16:44:19.172813 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 452/953] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:44:19 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1239 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:44:20.194881 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f510e305-f4d0-4999-8072-5c7a67d45bdb tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:44:20.195602 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f510e305-f4d0-4999-8072-5c7a67d45bdb tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:44:20.201953 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f510e305-f4d0-4999-8072-5c7a67d45bdb tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:20.202449 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f510e305-f4d0-4999-8072-5c7a67d45bdb tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:20.202939 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f510e305-f4d0-4999-8072-5c7a67d45bdb tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:20.203774 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f510e305-f4d0-4999-8072-5c7a67d45bdb tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:20.204265 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f510e305-f4d0-4999-8072-5c7a67d45bdb tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:20.204693 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f510e305-f4d0-4999-8072-5c7a67d45bdb tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:20.270052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f510e305-f4d0-4999-8072-5c7a67d45bdb tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:44:20.278224 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f510e305-f4d0-4999-8072-5c7a67d45bdb tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1287 microversion: 2.1 time: 0.086785 Sep 27 16:44:20.279155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 502/954] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:44:20 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:44:21.301119 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a8002fff-c5a5-4662-87b5-93d570568d55 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:44:21.301724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a8002fff-c5a5-4662-87b5-93d570568d55 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:44:21.308485 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8002fff-c5a5-4662-87b5-93d570568d55 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:21.308966 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8002fff-c5a5-4662-87b5-93d570568d55 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:21.310250 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8002fff-c5a5-4662-87b5-93d570568d55 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:21.310972 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8002fff-c5a5-4662-87b5-93d570568d55 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:21.311422 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8002fff-c5a5-4662-87b5-93d570568d55 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:21.311882 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8002fff-c5a5-4662-87b5-93d570568d55 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:21.376953 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a8002fff-c5a5-4662-87b5-93d570568d55 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:44:21.384701 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a8002fff-c5a5-4662-87b5-93d570568d55 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1293 microversion: 2.1 time: 0.087476 Sep 27 16:44:21.385252 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 453/955] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:44:21 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:44:22.386228 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-36f9880b-6510-43c5-9c02-ee21613493eb req-58a92eac-1e9e-4869-8af0-7aa6e9a97e68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23412d14-1e6d-4792-b23b-591d19c2bd7e", "tag": "82f04415-4ca4-4d99-88bc-515bfb4984d7"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:44:22.397939 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-36f9880b-6510-43c5-9c02-ee21613493eb req-58a92eac-1e9e-4869-8af0-7aa6e9a97e68 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:22.398737 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-36f9880b-6510-43c5-9c02-ee21613493eb req-58a92eac-1e9e-4869-8af0-7aa6e9a97e68 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:22.399146 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-36f9880b-6510-43c5-9c02-ee21613493eb req-58a92eac-1e9e-4869-8af0-7aa6e9a97e68 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:22.409085 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b0773e84-daea-48e8-8d16-a1b05edb9819 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:44:22.409688 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b0773e84-daea-48e8-8d16-a1b05edb9819 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:44:22.411623 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-36f9880b-6510-43c5-9c02-ee21613493eb req-58a92eac-1e9e-4869-8af0-7aa6e9a97e68 service nova] Creating event network-changed:82f04415-4ca4-4d99-88bc-515bfb4984d7 for instance 23412d14-1e6d-4792-b23b-591d19c2bd7e on hv-cinder-85506 Sep 27 16:44:22.416638 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-36f9880b-6510-43c5-9c02-ee21613493eb req-58a92eac-1e9e-4869-8af0-7aa6e9a97e68 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034140 Sep 27 16:44:22.417570 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 503/956] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:44:22.418108 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0773e84-daea-48e8-8d16-a1b05edb9819 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:22.418924 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0773e84-daea-48e8-8d16-a1b05edb9819 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:22.419537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0773e84-daea-48e8-8d16-a1b05edb9819 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:22.420245 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0773e84-daea-48e8-8d16-a1b05edb9819 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:22.420702 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0773e84-daea-48e8-8d16-a1b05edb9819 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:22.421122 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b0773e84-daea-48e8-8d16-a1b05edb9819 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:22.579137 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b0773e84-daea-48e8-8d16-a1b05edb9819 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:44:22.587483 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b0773e84-daea-48e8-8d16-a1b05edb9819 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1360 microversion: 2.1 time: 0.182581 Sep 27 16:44:22.591411 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 454/957] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:44:22 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1360 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:44:23.619563 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f12cec05-e973-4739-8ce6-cffb21e07161 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:44:23.619563 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f12cec05-e973-4739-8ce6-cffb21e07161 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:44:23.619563 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f12cec05-e973-4739-8ce6-cffb21e07161 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:23.619563 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f12cec05-e973-4739-8ce6-cffb21e07161 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:23.620233 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f12cec05-e973-4739-8ce6-cffb21e07161 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:23.620462 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f12cec05-e973-4739-8ce6-cffb21e07161 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:23.621089 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f12cec05-e973-4739-8ce6-cffb21e07161 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:23.621574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f12cec05-e973-4739-8ce6-cffb21e07161 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:23.759326 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f12cec05-e973-4739-8ce6-cffb21e07161 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:44:23.768324 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f12cec05-e973-4739-8ce6-cffb21e07161 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1360 microversion: 2.1 time: 0.162253 Sep 27 16:44:23.775098 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 504/958] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:44:23 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1360 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:44:24.792602 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e2446fe4-b520-4a93-886d-29eb910c2c85 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:44:24.793244 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e2446fe4-b520-4a93-886d-29eb910c2c85 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:44:24.799945 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2446fe4-b520-4a93-886d-29eb910c2c85 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:24.801232 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2446fe4-b520-4a93-886d-29eb910c2c85 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:24.801232 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2446fe4-b520-4a93-886d-29eb910c2c85 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:24.801617 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2446fe4-b520-4a93-886d-29eb910c2c85 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:24.802082 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2446fe4-b520-4a93-886d-29eb910c2c85 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:24.802510 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2446fe4-b520-4a93-886d-29eb910c2c85 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:24.938080 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e2446fe4-b520-4a93-886d-29eb910c2c85 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:44:24.945785 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e2446fe4-b520-4a93-886d-29eb910c2c85 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1360 microversion: 2.1 time: 0.157078 Sep 27 16:44:24.946384 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 455/959] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:44:24 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1360 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:44:25.975204 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4862d43b-e9dd-492a-9133-587b839885ee tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:44:25.976335 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4862d43b-e9dd-492a-9133-587b839885ee tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:44:25.983055 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4862d43b-e9dd-492a-9133-587b839885ee tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:25.983546 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4862d43b-e9dd-492a-9133-587b839885ee tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:25.983985 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4862d43b-e9dd-492a-9133-587b839885ee tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:25.984677 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4862d43b-e9dd-492a-9133-587b839885ee tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:25.985133 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4862d43b-e9dd-492a-9133-587b839885ee tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:25.985733 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4862d43b-e9dd-492a-9133-587b839885ee tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:26.120939 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4862d43b-e9dd-492a-9133-587b839885ee tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:44:26.129849 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4862d43b-e9dd-492a-9133-587b839885ee tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1360 microversion: 2.1 time: 0.164634 Sep 27 16:44:26.130351 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 505/960] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:44:25 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1360 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:44:27.154266 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c38e08fa-8647-4cbf-a0c7-f1cd5bf275ec tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:44:27.155532 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c38e08fa-8647-4cbf-a0c7-f1cd5bf275ec tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:44:27.163090 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c38e08fa-8647-4cbf-a0c7-f1cd5bf275ec tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:27.168319 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c38e08fa-8647-4cbf-a0c7-f1cd5bf275ec tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:27.168319 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c38e08fa-8647-4cbf-a0c7-f1cd5bf275ec tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:27.168319 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c38e08fa-8647-4cbf-a0c7-f1cd5bf275ec tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:27.168319 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c38e08fa-8647-4cbf-a0c7-f1cd5bf275ec tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:27.168704 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c38e08fa-8647-4cbf-a0c7-f1cd5bf275ec tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:27.327206 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c38e08fa-8647-4cbf-a0c7-f1cd5bf275ec tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:44:27.335040 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c38e08fa-8647-4cbf-a0c7-f1cd5bf275ec tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1360 microversion: 2.1 time: 0.184979 Sep 27 16:44:27.335611 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 456/961] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:44:27 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1360 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:44:28.131171 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-ae1ba30c-6da8-4d01-a562-10938d6f3d8b req-c6775511-5e38-426b-bb14-38263a71cbca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23412d14-1e6d-4792-b23b-591d19c2bd7e", "name": "network-vif-plugged", "status": "completed", "tag": "82f04415-4ca4-4d99-88bc-515bfb4984d7"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:44:28.136426 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=6 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:28.142359 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-ae1ba30c-6da8-4d01-a562-10938d6f3d8b req-c6775511-5e38-426b-bb14-38263a71cbca service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:28.142861 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-ae1ba30c-6da8-4d01-a562-10938d6f3d8b req-c6775511-5e38-426b-bb14-38263a71cbca service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:28.143295 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-ae1ba30c-6da8-4d01-a562-10938d6f3d8b req-c6775511-5e38-426b-bb14-38263a71cbca service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:28.155167 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-ae1ba30c-6da8-4d01-a562-10938d6f3d8b req-c6775511-5e38-426b-bb14-38263a71cbca service nova] Creating event network-vif-plugged:82f04415-4ca4-4d99-88bc-515bfb4984d7 for instance 23412d14-1e6d-4792-b23b-591d19c2bd7e on hv-cinder-85506 Sep 27 16:44:28.160158 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-ae1ba30c-6da8-4d01-a562-10938d6f3d8b req-c6775511-5e38-426b-bb14-38263a71cbca service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032670 Sep 27 16:44:28.160675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 506/962] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:44:28.369524 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-61cc6925-425c-4ec7-98f0-b702ad30f25d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:44:28.370423 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-61cc6925-425c-4ec7-98f0-b702ad30f25d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:44:28.372412 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:28.373071 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=6 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:44:28.379089 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-61cc6925-425c-4ec7-98f0-b702ad30f25d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:28.379581 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-61cc6925-425c-4ec7-98f0-b702ad30f25d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:28.380016 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-61cc6925-425c-4ec7-98f0-b702ad30f25d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:28.380768 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-61cc6925-425c-4ec7-98f0-b702ad30f25d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:28.381618 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-61cc6925-425c-4ec7-98f0-b702ad30f25d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:28.381944 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-61cc6925-425c-4ec7-98f0-b702ad30f25d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:28.559720 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-61cc6925-425c-4ec7-98f0-b702ad30f25d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:44:28.568313 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-61cc6925-425c-4ec7-98f0-b702ad30f25d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1360 microversion: 2.1 time: 0.213825 Sep 27 16:44:28.569668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 457/963] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:44:28 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1360 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:44:29.592172 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a461b0d8-fdb1-4e43-8c72-13da649f0d8e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:44:29.592957 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a461b0d8-fdb1-4e43-8c72-13da649f0d8e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:44:29.599622 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a461b0d8-fdb1-4e43-8c72-13da649f0d8e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:29.600107 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a461b0d8-fdb1-4e43-8c72-13da649f0d8e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:29.600542 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a461b0d8-fdb1-4e43-8c72-13da649f0d8e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:29.601230 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a461b0d8-fdb1-4e43-8c72-13da649f0d8e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:29.601694 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a461b0d8-fdb1-4e43-8c72-13da649f0d8e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:29.602224 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a461b0d8-fdb1-4e43-8c72-13da649f0d8e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:29.739170 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a461b0d8-fdb1-4e43-8c72-13da649f0d8e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:44:29.747323 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a461b0d8-fdb1-4e43-8c72-13da649f0d8e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1360 microversion: 2.1 time: 0.158837 Sep 27 16:44:29.749362 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 507/964] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:44:29 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1360 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:44:30.769640 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-aaa49eac-c81c-4d3c-a914-5c138c20ae0b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:44:30.770249 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-aaa49eac-c81c-4d3c-a914-5c138c20ae0b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:44:30.777404 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aaa49eac-c81c-4d3c-a914-5c138c20ae0b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:30.777886 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aaa49eac-c81c-4d3c-a914-5c138c20ae0b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:30.778490 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aaa49eac-c81c-4d3c-a914-5c138c20ae0b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:30.779213 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aaa49eac-c81c-4d3c-a914-5c138c20ae0b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:30.780198 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aaa49eac-c81c-4d3c-a914-5c138c20ae0b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:30.780575 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aaa49eac-c81c-4d3c-a914-5c138c20ae0b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:30.909928 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-aaa49eac-c81c-4d3c-a914-5c138c20ae0b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:44:30.917652 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-aaa49eac-c81c-4d3c-a914-5c138c20ae0b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1547 microversion: 2.1 time: 0.151957 Sep 27 16:44:30.918146 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 458/965] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:44:30 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:44:30.941249 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-735a3319-0564-4672-a63d-635914aa37d4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:44:30.946419 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-735a3319-0564-4672-a63d-635914aa37d4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:44:30.947927 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-735a3319-0564-4672-a63d-635914aa37d4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:30.948424 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-735a3319-0564-4672-a63d-635914aa37d4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:30.948864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-735a3319-0564-4672-a63d-635914aa37d4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:30.949630 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-735a3319-0564-4672-a63d-635914aa37d4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:30.950001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-735a3319-0564-4672-a63d-635914aa37d4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:30.950423 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-735a3319-0564-4672-a63d-635914aa37d4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:31.033001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-735a3319-0564-4672-a63d-635914aa37d4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095972 Sep 27 16:44:31.033603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 508/966] 10.222.0.64 () {58 vars in 1275 bytes} [Tue Sep 27 16:44:30 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:44:32.463514 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-c366aff1-0284-4214-a8af-c546c99e6f65 req-7a17a532-2ab1-4180-89f9-c72db849004a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23412d14-1e6d-4792-b23b-591d19c2bd7e", "tag": "82f04415-4ca4-4d99-88bc-515bfb4984d7"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:44:32.474646 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-c366aff1-0284-4214-a8af-c546c99e6f65 req-7a17a532-2ab1-4180-89f9-c72db849004a service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:44:32.475277 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-c366aff1-0284-4214-a8af-c546c99e6f65 req-7a17a532-2ab1-4180-89f9-c72db849004a service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:44:32.475810 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-c366aff1-0284-4214-a8af-c546c99e6f65 req-7a17a532-2ab1-4180-89f9-c72db849004a service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:44:32.488546 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-c366aff1-0284-4214-a8af-c546c99e6f65 req-7a17a532-2ab1-4180-89f9-c72db849004a service nova] Creating event network-changed:82f04415-4ca4-4d99-88bc-515bfb4984d7 for instance 23412d14-1e6d-4792-b23b-591d19c2bd7e on hv-cinder-85506 Sep 27 16:44:32.493896 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-c366aff1-0284-4214-a8af-c546c99e6f65 req-7a17a532-2ab1-4180-89f9-c72db849004a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034241 Sep 27 16:44:32.494491 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 459/967] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:45:16.228236 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:16.228995 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=32 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:16.233510 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4d09f144-41c1-41a4-a50f-ad7fbe4d0b45 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:16.234001 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4d09f144-41c1-41a4-a50f-ad7fbe4d0b45 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:16.240000 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d09f144-41c1-41a4-a50f-ad7fbe4d0b45 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:16.240481 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d09f144-41c1-41a4-a50f-ad7fbe4d0b45 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:16.240915 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d09f144-41c1-41a4-a50f-ad7fbe4d0b45 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:16.241713 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d09f144-41c1-41a4-a50f-ad7fbe4d0b45 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:16.242169 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d09f144-41c1-41a4-a50f-ad7fbe4d0b45 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:16.242595 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d09f144-41c1-41a4-a50f-ad7fbe4d0b45 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:16.265687 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4d09f144-41c1-41a4-a50f-ad7fbe4d0b45 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e/ips" status: 200 len: 147 microversion: 2.1 time: 0.038440 Sep 27 16:45:16.266262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 509/968] 10.222.0.64 () {58 vars in 1248 bytes} [Tue Sep 27 16:45:16 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e/ips => generated 147 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:45:19.803189 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e6c95559-50d3-47ff-bb43-996685aea5e8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db19b5b3-d27a-4a50-bedc-81fc6625fcea"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:45:19.805678 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e6c95559-50d3-47ff-bb43-996685aea5e8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:19.808202 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:19.808840 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=46 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:19.814170 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6c95559-50d3-47ff-bb43-996685aea5e8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:19.814639 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6c95559-50d3-47ff-bb43-996685aea5e8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:19.815099 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6c95559-50d3-47ff-bb43-996685aea5e8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:19.815800 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6c95559-50d3-47ff-bb43-996685aea5e8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:19.816254 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6c95559-50d3-47ff-bb43-996685aea5e8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:19.817275 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6c95559-50d3-47ff-bb43-996685aea5e8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:20.615108 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e6c95559-50d3-47ff-bb43-996685aea5e8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "POST /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.816945 Sep 27 16:45:20.615718 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 460/969] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Sep 27 16:45:19 2022] POST /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e/os-volume_attachments => generated 194 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:45:23.032934 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-665d2dc0-8d3f-4c59-b057-bc3741713809 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-245949241", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-878616145", "security_groups": [{"name": "tempest-secgroup-smoke-849232985"}], "block_device_mapping_v2": [{"uuid": "92952195-f472-4897-8a30-d7647d179252", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fa6ed79c-29cf-4084-8c9a-3f99a2a02140"}]}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:45:23.158113 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-665d2dc0-8d3f-4c59-b057-bc3741713809 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] validate_networks() for [('fa6ed79c-29cf-4084-8c9a-3f99a2a02140', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 16:45:23.531627 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-665d2dc0-8d3f-4c59-b057-bc3741713809 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 16:45:23.532053 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-665d2dc0-8d3f-4c59-b057-bc3741713809 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 16:45:23.532528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-665d2dc0-8d3f-4c59-b057-bc3741713809 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 16:45:23.532962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-665d2dc0-8d3f-4c59-b057-bc3741713809 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 16:45:23.533374 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-665d2dc0-8d3f-4c59-b057-bc3741713809 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 16:45:23.542189 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-665d2dc0-8d3f-4c59-b057-bc3741713809 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:23.542676 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-665d2dc0-8d3f-4c59-b057-bc3741713809 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:23.543159 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-665d2dc0-8d3f-4c59-b057-bc3741713809 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:23.543960 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-665d2dc0-8d3f-4c59-b057-bc3741713809 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:23.544437 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-665d2dc0-8d3f-4c59-b057-bc3741713809 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:23.544866 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-665d2dc0-8d3f-4c59-b057-bc3741713809 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:23.562109 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-665d2dc0-8d3f-4c59-b057-bc3741713809 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Getting quotas for project 1e0f894b53284e788cdb4864acd917be. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:45:23.566135 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-665d2dc0-8d3f-4c59-b057-bc3741713809 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Getting quotas for user 421aaa238a3c495096dfc55aba76267c and project 1e0f894b53284e788cdb4864acd917be. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:45:23.622967 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-665d2dc0-8d3f-4c59-b057-bc3741713809 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 16:45:23.625167 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-665d2dc0-8d3f-4c59-b057-bc3741713809 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='92952195-f472-4897-8a30-d7647d179252',volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 16:45:24.097080 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-665d2dc0-8d3f-4c59-b057-bc3741713809 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.067866 Sep 27 16:45:24.097704 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 510/970] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Sep 27 16:45:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 16:45:24.110626 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-28fbd6cc-aa38-4078-be93-2206793d9d65 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:24.111618 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-28fbd6cc-aa38-4078-be93-2206793d9d65 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:24.170596 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-28fbd6cc-aa38-4078-be93-2206793d9d65 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:24.178273 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-28fbd6cc-aa38-4078-be93-2206793d9d65 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1093 microversion: 2.1 time: 0.072524 Sep 27 16:45:24.178864 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 461/971] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:24 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:25.200994 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ebf67ec9-2b8e-4b32-b825-6c7e7408087b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:25.201639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ebf67ec9-2b8e-4b32-b825-6c7e7408087b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:25.207751 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebf67ec9-2b8e-4b32-b825-6c7e7408087b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:25.208437 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebf67ec9-2b8e-4b32-b825-6c7e7408087b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:25.208978 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebf67ec9-2b8e-4b32-b825-6c7e7408087b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:25.209677 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebf67ec9-2b8e-4b32-b825-6c7e7408087b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:25.210141 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebf67ec9-2b8e-4b32-b825-6c7e7408087b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:25.210571 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebf67ec9-2b8e-4b32-b825-6c7e7408087b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:25.273657 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ebf67ec9-2b8e-4b32-b825-6c7e7408087b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:25.281815 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ebf67ec9-2b8e-4b32-b825-6c7e7408087b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1143 microversion: 2.1 time: 0.084910 Sep 27 16:45:25.282381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 511/972] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:25 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1143 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:26.305509 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a38ef637-ea21-4399-839c-be3b9235bcd8 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:26.306053 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a38ef637-ea21-4399-839c-be3b9235bcd8 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:26.313815 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a38ef637-ea21-4399-839c-be3b9235bcd8 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:26.314289 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a38ef637-ea21-4399-839c-be3b9235bcd8 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:26.314717 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a38ef637-ea21-4399-839c-be3b9235bcd8 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:26.315426 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a38ef637-ea21-4399-839c-be3b9235bcd8 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:26.315904 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a38ef637-ea21-4399-839c-be3b9235bcd8 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:26.316322 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a38ef637-ea21-4399-839c-be3b9235bcd8 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:26.377942 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a38ef637-ea21-4399-839c-be3b9235bcd8 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:26.386287 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a38ef637-ea21-4399-839c-be3b9235bcd8 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1191 microversion: 2.1 time: 0.084951 Sep 27 16:45:26.386861 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 462/973] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:26 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:27.412563 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7156862f-b501-4293-ae4f-db085fc712e0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:27.413354 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7156862f-b501-4293-ae4f-db085fc712e0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:27.419366 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7156862f-b501-4293-ae4f-db085fc712e0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:27.419850 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7156862f-b501-4293-ae4f-db085fc712e0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:27.420285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7156862f-b501-4293-ae4f-db085fc712e0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:27.420974 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7156862f-b501-4293-ae4f-db085fc712e0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:27.421440 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7156862f-b501-4293-ae4f-db085fc712e0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:27.421854 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7156862f-b501-4293-ae4f-db085fc712e0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:27.482397 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7156862f-b501-4293-ae4f-db085fc712e0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:27.490246 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7156862f-b501-4293-ae4f-db085fc712e0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1209 microversion: 2.1 time: 0.082295 Sep 27 16:45:27.490833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 512/974] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:27 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1209 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:28.523544 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-26b27ac1-60a4-4955-bc81-5eda3778c5c6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:28.524152 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-26b27ac1-60a4-4955-bc81-5eda3778c5c6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:28.532307 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26b27ac1-60a4-4955-bc81-5eda3778c5c6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:28.532801 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26b27ac1-60a4-4955-bc81-5eda3778c5c6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:28.533251 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26b27ac1-60a4-4955-bc81-5eda3778c5c6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:28.533984 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26b27ac1-60a4-4955-bc81-5eda3778c5c6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:28.534448 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26b27ac1-60a4-4955-bc81-5eda3778c5c6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:28.534904 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26b27ac1-60a4-4955-bc81-5eda3778c5c6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:28.694368 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-26b27ac1-60a4-4955-bc81-5eda3778c5c6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:28.702673 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-26b27ac1-60a4-4955-bc81-5eda3778c5c6 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1276 microversion: 2.1 time: 0.184355 Sep 27 16:45:28.703288 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 463/975] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:28 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1276 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:28.878434 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-8aeb4af7-7709-4981-b69f-f9f6aa3ff2fe req-d1788b18-4944-4693-82c0-51aec0b1b108 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be9bfe87-9e1d-4f29-8d03-64ff185cce85", "tag": "de86fe62-fa12-4e70-a861-ea2d30bbe40e"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:45:28.888940 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8aeb4af7-7709-4981-b69f-f9f6aa3ff2fe req-d1788b18-4944-4693-82c0-51aec0b1b108 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:28.889506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8aeb4af7-7709-4981-b69f-f9f6aa3ff2fe req-d1788b18-4944-4693-82c0-51aec0b1b108 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:28.889964 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8aeb4af7-7709-4981-b69f-f9f6aa3ff2fe req-d1788b18-4944-4693-82c0-51aec0b1b108 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:28.901847 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-8aeb4af7-7709-4981-b69f-f9f6aa3ff2fe req-d1788b18-4944-4693-82c0-51aec0b1b108 service nova] Creating event network-changed:de86fe62-fa12-4e70-a861-ea2d30bbe40e for instance be9bfe87-9e1d-4f29-8d03-64ff185cce85 on hv-cinder-85506 Sep 27 16:45:28.907120 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-8aeb4af7-7709-4981-b69f-f9f6aa3ff2fe req-d1788b18-4944-4693-82c0-51aec0b1b108 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032539 Sep 27 16:45:28.907879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 513/976] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:45:29.303874 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c747ba26-bd31-4ddb-b832-6da000f611cd tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:45:29.310184 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c747ba26-bd31-4ddb-b832-6da000f611cd tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:29.310668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c747ba26-bd31-4ddb-b832-6da000f611cd tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:29.311185 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c747ba26-bd31-4ddb-b832-6da000f611cd tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:29.374090 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c747ba26-bd31-4ddb-b832-6da000f611cd tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Going to try to stop instance {{(pid=127617) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 27 16:45:29.579047 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c747ba26-bd31-4ddb-b832-6da000f611cd tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "POST /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e/action" status: 202 len: 0 microversion: 2.1 time: 0.279948 Sep 27 16:45:29.579899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 464/977] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Sep 27 16:45:29 2022] POST /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:45:29.588715 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7082bdf2-08f7-4fd7-a8a6-a69b5a09e95a tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:29.589423 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7082bdf2-08f7-4fd7-a8a6-a69b5a09e95a tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:29.595767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7082bdf2-08f7-4fd7-a8a6-a69b5a09e95a tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:29.596266 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7082bdf2-08f7-4fd7-a8a6-a69b5a09e95a tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:29.596847 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7082bdf2-08f7-4fd7-a8a6-a69b5a09e95a tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:29.597670 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7082bdf2-08f7-4fd7-a8a6-a69b5a09e95a tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:29.598131 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7082bdf2-08f7-4fd7-a8a6-a69b5a09e95a tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:29.598563 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7082bdf2-08f7-4fd7-a8a6-a69b5a09e95a tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:29.727022 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8b8e17bf-70b8-4a72-ab8c-d78945a0315b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:29.732514 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8b8e17bf-70b8-4a72-ab8c-d78945a0315b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:29.733961 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b8e17bf-70b8-4a72-ab8c-d78945a0315b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:29.734518 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b8e17bf-70b8-4a72-ab8c-d78945a0315b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:29.735049 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b8e17bf-70b8-4a72-ab8c-d78945a0315b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:29.735978 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b8e17bf-70b8-4a72-ab8c-d78945a0315b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:29.736493 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b8e17bf-70b8-4a72-ab8c-d78945a0315b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:29.737141 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b8e17bf-70b8-4a72-ab8c-d78945a0315b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:29.766894 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7082bdf2-08f7-4fd7-a8a6-a69b5a09e95a tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:29.769987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7082bdf2-08f7-4fd7-a8a6-a69b5a09e95a tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1722 microversion: 2.1 time: 0.185618 Sep 27 16:45:29.776561 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 514/978] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:29 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:29.880064 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8b8e17bf-70b8-4a72-ab8c-d78945a0315b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:29.889247 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8b8e17bf-70b8-4a72-ab8c-d78945a0315b tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1276 microversion: 2.1 time: 0.167240 Sep 27 16:45:29.914813 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 465/979] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:29 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1276 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:45:30.794168 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5692ca8e-c095-4168-9762-2246a55faa6f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:30.794807 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5692ca8e-c095-4168-9762-2246a55faa6f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:30.801083 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5692ca8e-c095-4168-9762-2246a55faa6f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:30.801966 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5692ca8e-c095-4168-9762-2246a55faa6f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:30.803472 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5692ca8e-c095-4168-9762-2246a55faa6f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:30.804348 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5692ca8e-c095-4168-9762-2246a55faa6f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:30.804814 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5692ca8e-c095-4168-9762-2246a55faa6f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:30.805250 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5692ca8e-c095-4168-9762-2246a55faa6f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:30.936013 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6fdc438d-ba83-4d5c-9509-9efd62dfcb13 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:30.936735 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6fdc438d-ba83-4d5c-9509-9efd62dfcb13 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:30.939453 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5692ca8e-c095-4168-9762-2246a55faa6f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:30.943937 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fdc438d-ba83-4d5c-9509-9efd62dfcb13 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:30.944472 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fdc438d-ba83-4d5c-9509-9efd62dfcb13 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:30.945050 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fdc438d-ba83-4d5c-9509-9efd62dfcb13 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:30.945923 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fdc438d-ba83-4d5c-9509-9efd62dfcb13 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:30.946379 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fdc438d-ba83-4d5c-9509-9efd62dfcb13 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:30.946817 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fdc438d-ba83-4d5c-9509-9efd62dfcb13 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:30.949589 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5692ca8e-c095-4168-9762-2246a55faa6f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1722 microversion: 2.1 time: 0.159358 Sep 27 16:45:30.950173 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 515/980] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:30 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:31.078203 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6fdc438d-ba83-4d5c-9509-9efd62dfcb13 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:31.086693 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6fdc438d-ba83-4d5c-9509-9efd62dfcb13 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1264 microversion: 2.1 time: 0.154870 Sep 27 16:45:31.087285 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 466/981] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:30 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:45:31.972890 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bed6c304-af55-4542-ba82-026cabd1a956 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:31.973518 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bed6c304-af55-4542-ba82-026cabd1a956 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:31.979873 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bed6c304-af55-4542-ba82-026cabd1a956 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:31.980362 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bed6c304-af55-4542-ba82-026cabd1a956 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:31.980791 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bed6c304-af55-4542-ba82-026cabd1a956 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:31.981502 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bed6c304-af55-4542-ba82-026cabd1a956 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:31.981952 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bed6c304-af55-4542-ba82-026cabd1a956 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:31.982371 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bed6c304-af55-4542-ba82-026cabd1a956 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:32.110097 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fb71a5a7-66d1-47f2-957f-a41a90a924f9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:32.110867 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fb71a5a7-66d1-47f2-957f-a41a90a924f9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:32.118241 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb71a5a7-66d1-47f2-957f-a41a90a924f9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:32.118732 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb71a5a7-66d1-47f2-957f-a41a90a924f9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:32.119197 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb71a5a7-66d1-47f2-957f-a41a90a924f9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:32.119908 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb71a5a7-66d1-47f2-957f-a41a90a924f9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:32.120428 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb71a5a7-66d1-47f2-957f-a41a90a924f9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:32.120884 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb71a5a7-66d1-47f2-957f-a41a90a924f9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:32.262476 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bed6c304-af55-4542-ba82-026cabd1a956 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:32.270269 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bed6c304-af55-4542-ba82-026cabd1a956 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1722 microversion: 2.1 time: 0.301186 Sep 27 16:45:32.270864 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 516/982] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:31 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1722 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:32.371096 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fb71a5a7-66d1-47f2-957f-a41a90a924f9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:32.378798 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fb71a5a7-66d1-47f2-957f-a41a90a924f9 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1264 microversion: 2.1 time: 0.272717 Sep 27 16:45:32.379362 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 467/983] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:32 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1264 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:45:33.295128 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4ce6e9b8-395c-43cd-ae03-4888c80933fd tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:33.295677 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4ce6e9b8-395c-43cd-ae03-4888c80933fd tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:33.301499 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ce6e9b8-395c-43cd-ae03-4888c80933fd tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:33.301984 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ce6e9b8-395c-43cd-ae03-4888c80933fd tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:33.302838 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ce6e9b8-395c-43cd-ae03-4888c80933fd tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:33.303546 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ce6e9b8-395c-43cd-ae03-4888c80933fd tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:33.304007 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ce6e9b8-395c-43cd-ae03-4888c80933fd tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:33.304436 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ce6e9b8-395c-43cd-ae03-4888c80933fd tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:33.402275 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-60cf546b-e08c-4328-8d31-fbfe4bfd8072 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:33.402920 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-60cf546b-e08c-4328-8d31-fbfe4bfd8072 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:33.409346 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60cf546b-e08c-4328-8d31-fbfe4bfd8072 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:33.409837 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60cf546b-e08c-4328-8d31-fbfe4bfd8072 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:33.410311 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60cf546b-e08c-4328-8d31-fbfe4bfd8072 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:33.411039 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60cf546b-e08c-4328-8d31-fbfe4bfd8072 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:33.412100 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60cf546b-e08c-4328-8d31-fbfe4bfd8072 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:33.412551 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60cf546b-e08c-4328-8d31-fbfe4bfd8072 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:33.444480 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4ce6e9b8-395c-43cd-ae03-4888c80933fd tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:33.453215 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4ce6e9b8-395c-43cd-ae03-4888c80933fd tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1722 microversion: 2.1 time: 0.162066 Sep 27 16:45:33.457877 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 517/984] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:33 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:33.545936 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-60cf546b-e08c-4328-8d31-fbfe4bfd8072 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:33.554396 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-60cf546b-e08c-4328-8d31-fbfe4bfd8072 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1264 microversion: 2.1 time: 0.156282 Sep 27 16:45:33.555255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 468/985] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:33 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:45:34.481161 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0ead0199-3d9b-4364-b8f2-b579fcb09d92 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:34.482506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0ead0199-3d9b-4364-b8f2-b579fcb09d92 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:34.486157 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:34.487045 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=6 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:34.491578 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ead0199-3d9b-4364-b8f2-b579fcb09d92 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:34.492161 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ead0199-3d9b-4364-b8f2-b579fcb09d92 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:34.492601 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ead0199-3d9b-4364-b8f2-b579fcb09d92 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:34.493308 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ead0199-3d9b-4364-b8f2-b579fcb09d92 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:34.493913 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ead0199-3d9b-4364-b8f2-b579fcb09d92 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:34.494259 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ead0199-3d9b-4364-b8f2-b579fcb09d92 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:34.576872 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:34.584800 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a0f70476-66d5-4a06-bb6e-29f9a22997f2 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:34.585448 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a0f70476-66d5-4a06-bb6e-29f9a22997f2 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:34.591974 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0f70476-66d5-4a06-bb6e-29f9a22997f2 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:34.592722 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0f70476-66d5-4a06-bb6e-29f9a22997f2 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:34.593154 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0f70476-66d5-4a06-bb6e-29f9a22997f2 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:34.594052 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0f70476-66d5-4a06-bb6e-29f9a22997f2 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:34.594515 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0f70476-66d5-4a06-bb6e-29f9a22997f2 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:34.594976 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0f70476-66d5-4a06-bb6e-29f9a22997f2 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:34.701125 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0ead0199-3d9b-4364-b8f2-b579fcb09d92 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:34.718833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0ead0199-3d9b-4364-b8f2-b579fcb09d92 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1722 microversion: 2.1 time: 0.234043 Sep 27 16:45:34.730813 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 518/986] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:34 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:34.781218 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a0f70476-66d5-4a06-bb6e-29f9a22997f2 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:34.791104 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a0f70476-66d5-4a06-bb6e-29f9a22997f2 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1264 microversion: 2.1 time: 0.214948 Sep 27 16:45:34.792231 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 469/987] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:34 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1264 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:35.745539 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c9c9a703-61fd-4c6b-be07-2ef7a0193ead tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:35.746214 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c9c9a703-61fd-4c6b-be07-2ef7a0193ead tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:35.753281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9c9a703-61fd-4c6b-be07-2ef7a0193ead tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:35.754078 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9c9a703-61fd-4c6b-be07-2ef7a0193ead tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:35.754521 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9c9a703-61fd-4c6b-be07-2ef7a0193ead tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:35.755877 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9c9a703-61fd-4c6b-be07-2ef7a0193ead tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:35.756509 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9c9a703-61fd-4c6b-be07-2ef7a0193ead tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:35.756902 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9c9a703-61fd-4c6b-be07-2ef7a0193ead tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:35.814844 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9a06ed8d-a3b7-4791-b83c-af47c3bd10e5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:35.815395 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9a06ed8d-a3b7-4791-b83c-af47c3bd10e5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:35.822460 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a06ed8d-a3b7-4791-b83c-af47c3bd10e5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:35.823014 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a06ed8d-a3b7-4791-b83c-af47c3bd10e5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:35.823452 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a06ed8d-a3b7-4791-b83c-af47c3bd10e5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:35.824312 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a06ed8d-a3b7-4791-b83c-af47c3bd10e5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:35.824979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a06ed8d-a3b7-4791-b83c-af47c3bd10e5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:35.825408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9a06ed8d-a3b7-4791-b83c-af47c3bd10e5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:35.935982 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c9c9a703-61fd-4c6b-be07-2ef7a0193ead tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:35.944766 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c9c9a703-61fd-4c6b-be07-2ef7a0193ead tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1722 microversion: 2.1 time: 0.203615 Sep 27 16:45:35.945346 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 519/988] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:35 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:35.988509 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9a06ed8d-a3b7-4791-b83c-af47c3bd10e5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:35.997030 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9a06ed8d-a3b7-4791-b83c-af47c3bd10e5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1264 microversion: 2.1 time: 0.187268 Sep 27 16:45:35.997612 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 470/989] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:35 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:45:36.968850 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-51eaf6eb-83bc-4b94-8ebe-67617fa9a823 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:36.969863 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-51eaf6eb-83bc-4b94-8ebe-67617fa9a823 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:36.975769 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51eaf6eb-83bc-4b94-8ebe-67617fa9a823 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:36.976259 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51eaf6eb-83bc-4b94-8ebe-67617fa9a823 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:36.977088 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51eaf6eb-83bc-4b94-8ebe-67617fa9a823 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:36.977544 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51eaf6eb-83bc-4b94-8ebe-67617fa9a823 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:36.978005 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51eaf6eb-83bc-4b94-8ebe-67617fa9a823 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:36.978432 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-51eaf6eb-83bc-4b94-8ebe-67617fa9a823 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:37.019938 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4ce6104e-7f63-4232-bd0c-bb33cf7ce35f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:37.020511 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4ce6104e-7f63-4232-bd0c-bb33cf7ce35f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:37.028297 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ce6104e-7f63-4232-bd0c-bb33cf7ce35f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:37.028785 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ce6104e-7f63-4232-bd0c-bb33cf7ce35f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:37.029252 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ce6104e-7f63-4232-bd0c-bb33cf7ce35f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:37.029960 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ce6104e-7f63-4232-bd0c-bb33cf7ce35f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:37.030432 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ce6104e-7f63-4232-bd0c-bb33cf7ce35f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:37.030902 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ce6104e-7f63-4232-bd0c-bb33cf7ce35f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:37.163541 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-51eaf6eb-83bc-4b94-8ebe-67617fa9a823 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:37.171755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-51eaf6eb-83bc-4b94-8ebe-67617fa9a823 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1722 microversion: 2.1 time: 0.206855 Sep 27 16:45:37.182426 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 520/990] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:36 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:37.195787 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4ce6104e-7f63-4232-bd0c-bb33cf7ce35f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:37.203524 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4ce6104e-7f63-4232-bd0c-bb33cf7ce35f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1264 microversion: 2.1 time: 0.187662 Sep 27 16:45:37.204094 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 471/991] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:37 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:38.197138 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-edbbfbd0-855a-4058-ae9f-650d0f139a25 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:38.198113 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-edbbfbd0-855a-4058-ae9f-650d0f139a25 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:38.204582 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-edbbfbd0-855a-4058-ae9f-650d0f139a25 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:38.205108 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-edbbfbd0-855a-4058-ae9f-650d0f139a25 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:38.205619 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-edbbfbd0-855a-4058-ae9f-650d0f139a25 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:38.206320 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-edbbfbd0-855a-4058-ae9f-650d0f139a25 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:38.206865 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-edbbfbd0-855a-4058-ae9f-650d0f139a25 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:38.210463 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-edbbfbd0-855a-4058-ae9f-650d0f139a25 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:38.232040 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ad4927c6-f409-485b-85c6-642558364336 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:38.232649 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ad4927c6-f409-485b-85c6-642558364336 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:38.240251 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad4927c6-f409-485b-85c6-642558364336 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:38.241025 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad4927c6-f409-485b-85c6-642558364336 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:38.241188 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad4927c6-f409-485b-85c6-642558364336 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:38.242072 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad4927c6-f409-485b-85c6-642558364336 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:38.242538 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad4927c6-f409-485b-85c6-642558364336 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:38.242998 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ad4927c6-f409-485b-85c6-642558364336 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:38.398087 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-edbbfbd0-855a-4058-ae9f-650d0f139a25 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:38.406699 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-edbbfbd0-855a-4058-ae9f-650d0f139a25 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1722 microversion: 2.1 time: 0.215234 Sep 27 16:45:38.407305 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 521/992] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:38 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:38.422269 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ad4927c6-f409-485b-85c6-642558364336 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:38.430393 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ad4927c6-f409-485b-85c6-642558364336 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1264 microversion: 2.1 time: 0.202372 Sep 27 16:45:38.431052 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 472/993] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:38 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1264 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:45:39.430541 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0f74b08c-2621-46dd-b46c-b60e72e7e327 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:39.431197 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0f74b08c-2621-46dd-b46c-b60e72e7e327 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:39.437157 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f74b08c-2621-46dd-b46c-b60e72e7e327 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:39.437643 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f74b08c-2621-46dd-b46c-b60e72e7e327 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:39.438183 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f74b08c-2621-46dd-b46c-b60e72e7e327 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:39.438905 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f74b08c-2621-46dd-b46c-b60e72e7e327 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:39.439363 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f74b08c-2621-46dd-b46c-b60e72e7e327 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:39.439785 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f74b08c-2621-46dd-b46c-b60e72e7e327 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:39.454106 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1bba247c-8eb4-4baf-a1c1-906816de88b1 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:39.454721 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1bba247c-8eb4-4baf-a1c1-906816de88b1 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:39.461756 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1bba247c-8eb4-4baf-a1c1-906816de88b1 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:39.462242 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1bba247c-8eb4-4baf-a1c1-906816de88b1 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:39.462678 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1bba247c-8eb4-4baf-a1c1-906816de88b1 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:39.463399 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1bba247c-8eb4-4baf-a1c1-906816de88b1 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:39.463855 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1bba247c-8eb4-4baf-a1c1-906816de88b1 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:39.464277 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1bba247c-8eb4-4baf-a1c1-906816de88b1 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:39.641584 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0f74b08c-2621-46dd-b46c-b60e72e7e327 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:39.646113 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1bba247c-8eb4-4baf-a1c1-906816de88b1 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:39.650634 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0f74b08c-2621-46dd-b46c-b60e72e7e327 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1722 microversion: 2.1 time: 0.223668 Sep 27 16:45:39.652251 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 522/994] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:39 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:39.654952 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1bba247c-8eb4-4baf-a1c1-906816de88b1 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1264 microversion: 2.1 time: 0.204622 Sep 27 16:45:39.655512 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 473/995] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:39 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1264 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:45:39.842140 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-dbb9d417-3aaa-4c43-8c3f-6e839a999b81 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:45:39.842863 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-dbb9d417-3aaa-4c43-8c3f-6e839a999b81 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:39.848982 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dbb9d417-3aaa-4c43-8c3f-6e839a999b81 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:39.849545 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dbb9d417-3aaa-4c43-8c3f-6e839a999b81 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:39.850120 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dbb9d417-3aaa-4c43-8c3f-6e839a999b81 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:39.850649 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dbb9d417-3aaa-4c43-8c3f-6e839a999b81 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:39.851139 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dbb9d417-3aaa-4c43-8c3f-6e839a999b81 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:39.851559 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dbb9d417-3aaa-4c43-8c3f-6e839a999b81 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:39.874165 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-dbb9d417-3aaa-4c43-8c3f-6e839a999b81 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lazy-loading 'flavor' on Instance uuid 800233b1-cc79-4eb5-9cdf-ff21e8321268 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:45:40.124247 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-dbb9d417-3aaa-4c43-8c3f-6e839a999b81 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "POST /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268/action" status: 202 len: 0 microversion: 2.1 time: 0.285793 Sep 27 16:45:40.124876 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 523/996] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Sep 27 16:45:39 2022] POST /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:45:40.133862 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-adedd883-8a03-4c0f-bea7-2b2fe24fcf20 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:40.134476 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-adedd883-8a03-4c0f-bea7-2b2fe24fcf20 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:40.140470 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-adedd883-8a03-4c0f-bea7-2b2fe24fcf20 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:40.140954 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-adedd883-8a03-4c0f-bea7-2b2fe24fcf20 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:40.141391 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-adedd883-8a03-4c0f-bea7-2b2fe24fcf20 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:40.142128 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-adedd883-8a03-4c0f-bea7-2b2fe24fcf20 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:40.142588 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-adedd883-8a03-4c0f-bea7-2b2fe24fcf20 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:40.143028 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-adedd883-8a03-4c0f-bea7-2b2fe24fcf20 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:40.275849 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-adedd883-8a03-4c0f-bea7-2b2fe24fcf20 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:40.283536 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-adedd883-8a03-4c0f-bea7-2b2fe24fcf20 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1571 microversion: 2.1 time: 0.154305 Sep 27 16:45:40.284099 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 474/997] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:40 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:40.673398 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2b335459-2398-48ad-a06b-a64f5a727d2b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:40.674104 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2b335459-2398-48ad-a06b-a64f5a727d2b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:40.677415 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d6bb21be-261a-4efc-aa8b-13ee42a42f2f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:40.678049 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d6bb21be-261a-4efc-aa8b-13ee42a42f2f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:40.680597 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2b335459-2398-48ad-a06b-a64f5a727d2b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:40.681108 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2b335459-2398-48ad-a06b-a64f5a727d2b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:40.681797 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2b335459-2398-48ad-a06b-a64f5a727d2b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:40.682282 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2b335459-2398-48ad-a06b-a64f5a727d2b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:40.682736 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2b335459-2398-48ad-a06b-a64f5a727d2b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:40.683188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2b335459-2398-48ad-a06b-a64f5a727d2b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:40.684893 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6bb21be-261a-4efc-aa8b-13ee42a42f2f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:40.685551 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6bb21be-261a-4efc-aa8b-13ee42a42f2f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:40.685991 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6bb21be-261a-4efc-aa8b-13ee42a42f2f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:40.686687 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6bb21be-261a-4efc-aa8b-13ee42a42f2f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:40.688447 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6bb21be-261a-4efc-aa8b-13ee42a42f2f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:40.688447 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6bb21be-261a-4efc-aa8b-13ee42a42f2f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:40.691905 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:40.879885 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2b335459-2398-48ad-a06b-a64f5a727d2b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:40.884537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d6bb21be-261a-4efc-aa8b-13ee42a42f2f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:40.888517 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2b335459-2398-48ad-a06b-a64f5a727d2b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1722 microversion: 2.1 time: 0.219339 Sep 27 16:45:40.889178 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 524/998] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:40 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:40.894839 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d6bb21be-261a-4efc-aa8b-13ee42a42f2f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1264 microversion: 2.1 time: 0.219293 Sep 27 16:45:40.894839 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 475/999] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:40 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1264 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:45:41.307870 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6688b3d9-a9ef-4bff-a2e2-36d896c09f40 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:41.308480 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6688b3d9-a9ef-4bff-a2e2-36d896c09f40 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:41.314469 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6688b3d9-a9ef-4bff-a2e2-36d896c09f40 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:41.314996 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6688b3d9-a9ef-4bff-a2e2-36d896c09f40 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:41.315437 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6688b3d9-a9ef-4bff-a2e2-36d896c09f40 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:41.316125 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6688b3d9-a9ef-4bff-a2e2-36d896c09f40 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:41.316582 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6688b3d9-a9ef-4bff-a2e2-36d896c09f40 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:41.317007 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6688b3d9-a9ef-4bff-a2e2-36d896c09f40 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:41.321763 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:41.451186 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6688b3d9-a9ef-4bff-a2e2-36d896c09f40 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:41.461054 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6688b3d9-a9ef-4bff-a2e2-36d896c09f40 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1571 microversion: 2.1 time: 0.156757 Sep 27 16:45:41.461423 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 525/1000] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:41 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:41.914013 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-47631235-74d9-455a-b594-d9a3cc44fb19 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:41.914565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-47631235-74d9-455a-b594-d9a3cc44fb19 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:41.916096 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-62f788d2-d1e5-492d-af70-bd6778e4feda tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:41.916704 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-62f788d2-d1e5-492d-af70-bd6778e4feda tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:41.921135 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47631235-74d9-455a-b594-d9a3cc44fb19 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:41.921626 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47631235-74d9-455a-b594-d9a3cc44fb19 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:41.922067 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47631235-74d9-455a-b594-d9a3cc44fb19 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:41.922652 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-62f788d2-d1e5-492d-af70-bd6778e4feda tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:41.922794 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47631235-74d9-455a-b594-d9a3cc44fb19 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:41.923170 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-62f788d2-d1e5-492d-af70-bd6778e4feda tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:41.923272 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47631235-74d9-455a-b594-d9a3cc44fb19 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:41.923608 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-62f788d2-d1e5-492d-af70-bd6778e4feda tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:41.923708 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47631235-74d9-455a-b594-d9a3cc44fb19 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:41.924291 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-62f788d2-d1e5-492d-af70-bd6778e4feda tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:41.924744 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-62f788d2-d1e5-492d-af70-bd6778e4feda tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:41.925162 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-62f788d2-d1e5-492d-af70-bd6778e4feda tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:42.118521 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-47631235-74d9-455a-b594-d9a3cc44fb19 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:42.122102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-62f788d2-d1e5-492d-af70-bd6778e4feda tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:42.126959 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-47631235-74d9-455a-b594-d9a3cc44fb19 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1722 microversion: 2.1 time: 0.217968 Sep 27 16:45:42.127533 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 476/1001] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:41 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:45:42.130093 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-62f788d2-d1e5-492d-af70-bd6778e4feda tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1264 microversion: 2.1 time: 0.218220 Sep 27 16:45:42.130651 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 526/1002] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:41 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1264 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:45:42.484826 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-22bdfb17-e509-4d02-ba0c-64a6ed2b1cce tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:42.485294 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-22bdfb17-e509-4d02-ba0c-64a6ed2b1cce tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:42.491266 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-22bdfb17-e509-4d02-ba0c-64a6ed2b1cce tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:42.491742 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-22bdfb17-e509-4d02-ba0c-64a6ed2b1cce tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:42.492185 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-22bdfb17-e509-4d02-ba0c-64a6ed2b1cce tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:42.493111 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-22bdfb17-e509-4d02-ba0c-64a6ed2b1cce tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:42.493573 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-22bdfb17-e509-4d02-ba0c-64a6ed2b1cce tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:42.493997 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-22bdfb17-e509-4d02-ba0c-64a6ed2b1cce tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:42.630730 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-22bdfb17-e509-4d02-ba0c-64a6ed2b1cce tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:42.639109 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-22bdfb17-e509-4d02-ba0c-64a6ed2b1cce tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1571 microversion: 2.1 time: 0.158303 Sep 27 16:45:42.639720 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 477/1003] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:42 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:43.149557 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-dc304f9d-ca9a-4995-8b50-18ed1a2eb2dc tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:43.150428 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-dc304f9d-ca9a-4995-8b50-18ed1a2eb2dc tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:43.152715 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4cdc2fea-1801-4822-ab45-9d148f382f41 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:43.153323 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4cdc2fea-1801-4822-ab45-9d148f382f41 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:43.156596 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc304f9d-ca9a-4995-8b50-18ed1a2eb2dc tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:43.157081 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc304f9d-ca9a-4995-8b50-18ed1a2eb2dc tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:43.157514 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc304f9d-ca9a-4995-8b50-18ed1a2eb2dc tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:43.158204 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc304f9d-ca9a-4995-8b50-18ed1a2eb2dc tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:43.158656 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc304f9d-ca9a-4995-8b50-18ed1a2eb2dc tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:43.159103 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dc304f9d-ca9a-4995-8b50-18ed1a2eb2dc tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:43.159647 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4cdc2fea-1801-4822-ab45-9d148f382f41 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:43.160134 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4cdc2fea-1801-4822-ab45-9d148f382f41 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:43.160574 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4cdc2fea-1801-4822-ab45-9d148f382f41 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:43.161271 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4cdc2fea-1801-4822-ab45-9d148f382f41 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:43.161726 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4cdc2fea-1801-4822-ab45-9d148f382f41 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:43.162148 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4cdc2fea-1801-4822-ab45-9d148f382f41 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:43.353887 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-dc304f9d-ca9a-4995-8b50-18ed1a2eb2dc tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:43.357591 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4cdc2fea-1801-4822-ab45-9d148f382f41 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:43.362399 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-dc304f9d-ca9a-4995-8b50-18ed1a2eb2dc tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1722 microversion: 2.1 time: 0.216828 Sep 27 16:45:43.362987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 527/1004] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:43 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:43.365504 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4cdc2fea-1801-4822-ab45-9d148f382f41 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1264 microversion: 2.1 time: 0.216919 Sep 27 16:45:43.366058 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 478/1005] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:43 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1264 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:45:43.663230 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-58a37f76-9f07-4058-921d-15dfc707ed57 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:43.663842 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-58a37f76-9f07-4058-921d-15dfc707ed57 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:43.670587 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58a37f76-9f07-4058-921d-15dfc707ed57 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:43.671207 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58a37f76-9f07-4058-921d-15dfc707ed57 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:43.671747 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58a37f76-9f07-4058-921d-15dfc707ed57 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:43.672624 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58a37f76-9f07-4058-921d-15dfc707ed57 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:43.673203 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58a37f76-9f07-4058-921d-15dfc707ed57 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:43.673719 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58a37f76-9f07-4058-921d-15dfc707ed57 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:43.811551 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-58a37f76-9f07-4058-921d-15dfc707ed57 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:43.819718 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-58a37f76-9f07-4058-921d-15dfc707ed57 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1571 microversion: 2.1 time: 0.160264 Sep 27 16:45:43.820255 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 528/1006] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:43 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:43.964816 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-a1509baf-fe34-42a0-86dc-508371226117 req-30add4f0-867e-4fd9-b9b0-65861af8d2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be9bfe87-9e1d-4f29-8d03-64ff185cce85", "name": "network-vif-plugged", "status": "completed", "tag": "de86fe62-fa12-4e70-a861-ea2d30bbe40e"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:45:43.974520 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a1509baf-fe34-42a0-86dc-508371226117 req-30add4f0-867e-4fd9-b9b0-65861af8d2d7 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:43.975024 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a1509baf-fe34-42a0-86dc-508371226117 req-30add4f0-867e-4fd9-b9b0-65861af8d2d7 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:43.975448 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a1509baf-fe34-42a0-86dc-508371226117 req-30add4f0-867e-4fd9-b9b0-65861af8d2d7 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:43.986239 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-a1509baf-fe34-42a0-86dc-508371226117 req-30add4f0-867e-4fd9-b9b0-65861af8d2d7 service nova] Creating event network-vif-plugged:de86fe62-fa12-4e70-a861-ea2d30bbe40e for instance be9bfe87-9e1d-4f29-8d03-64ff185cce85 on hv-cinder-85506 Sep 27 16:45:43.991205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-a1509baf-fe34-42a0-86dc-508371226117 req-30add4f0-867e-4fd9-b9b0-65861af8d2d7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030911 Sep 27 16:45:43.991783 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 479/1007] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:45:44.389071 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e56c3421-05b8-4c7b-bdd7-0a6f45f8497c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:44.389756 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-287e8ba3-fd61-4cfd-ac11-e47c96ac05b9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:44.391364 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e56c3421-05b8-4c7b-bdd7-0a6f45f8497c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:44.391465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-287e8ba3-fd61-4cfd-ac11-e47c96ac05b9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:44.396046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e56c3421-05b8-4c7b-bdd7-0a6f45f8497c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:44.396225 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-287e8ba3-fd61-4cfd-ac11-e47c96ac05b9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:44.396538 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e56c3421-05b8-4c7b-bdd7-0a6f45f8497c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:44.396658 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-287e8ba3-fd61-4cfd-ac11-e47c96ac05b9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:44.396974 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e56c3421-05b8-4c7b-bdd7-0a6f45f8497c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:44.397117 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-287e8ba3-fd61-4cfd-ac11-e47c96ac05b9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:44.397725 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e56c3421-05b8-4c7b-bdd7-0a6f45f8497c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:44.397847 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-287e8ba3-fd61-4cfd-ac11-e47c96ac05b9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:44.398124 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e56c3421-05b8-4c7b-bdd7-0a6f45f8497c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:44.398218 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-287e8ba3-fd61-4cfd-ac11-e47c96ac05b9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:44.398549 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e56c3421-05b8-4c7b-bdd7-0a6f45f8497c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:44.398640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-287e8ba3-fd61-4cfd-ac11-e47c96ac05b9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:44.593472 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e56c3421-05b8-4c7b-bdd7-0a6f45f8497c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:44.597643 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-287e8ba3-fd61-4cfd-ac11-e47c96ac05b9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:44.601250 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e56c3421-05b8-4c7b-bdd7-0a6f45f8497c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1264 microversion: 2.1 time: 0.216814 Sep 27 16:45:44.601816 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 480/1008] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:44 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1264 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:44.606035 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-287e8ba3-fd61-4cfd-ac11-e47c96ac05b9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1722 microversion: 2.1 time: 0.223300 Sep 27 16:45:44.606595 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 529/1009] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:44 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:44.843055 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3e8280ab-1b0a-4e17-aaa6-3dbbd0d68451 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:44.843669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3e8280ab-1b0a-4e17-aaa6-3dbbd0d68451 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:44.849674 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3e8280ab-1b0a-4e17-aaa6-3dbbd0d68451 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:44.850153 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3e8280ab-1b0a-4e17-aaa6-3dbbd0d68451 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:44.850585 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3e8280ab-1b0a-4e17-aaa6-3dbbd0d68451 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:44.851309 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3e8280ab-1b0a-4e17-aaa6-3dbbd0d68451 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:44.851761 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3e8280ab-1b0a-4e17-aaa6-3dbbd0d68451 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:44.852701 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3e8280ab-1b0a-4e17-aaa6-3dbbd0d68451 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:44.979369 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3e8280ab-1b0a-4e17-aaa6-3dbbd0d68451 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:44.987083 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3e8280ab-1b0a-4e17-aaa6-3dbbd0d68451 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1571 microversion: 2.1 time: 0.147923 Sep 27 16:45:44.987653 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 481/1010] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:44 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1571 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:45.623876 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6e18e180-8a5e-4f3d-80fc-fa6acf780586 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:45.624806 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6e18e180-8a5e-4f3d-80fc-fa6acf780586 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:45.629252 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6207aa77-fd85-401d-8162-92b246d71785 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:45.635285 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6207aa77-fd85-401d-8162-92b246d71785 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:45.635407 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e18e180-8a5e-4f3d-80fc-fa6acf780586 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:45.635407 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e18e180-8a5e-4f3d-80fc-fa6acf780586 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:45.635407 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e18e180-8a5e-4f3d-80fc-fa6acf780586 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:45.635407 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e18e180-8a5e-4f3d-80fc-fa6acf780586 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:45.635768 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e18e180-8a5e-4f3d-80fc-fa6acf780586 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:45.635768 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e18e180-8a5e-4f3d-80fc-fa6acf780586 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:45.636980 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6207aa77-fd85-401d-8162-92b246d71785 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:45.637472 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6207aa77-fd85-401d-8162-92b246d71785 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:45.637913 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6207aa77-fd85-401d-8162-92b246d71785 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:45.639297 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6207aa77-fd85-401d-8162-92b246d71785 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:45.639772 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6207aa77-fd85-401d-8162-92b246d71785 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:45.640207 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6207aa77-fd85-401d-8162-92b246d71785 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:45.840119 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6e18e180-8a5e-4f3d-80fc-fa6acf780586 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:45.843191 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6207aa77-fd85-401d-8162-92b246d71785 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:45.848527 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6e18e180-8a5e-4f3d-80fc-fa6acf780586 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1264 microversion: 2.1 time: 0.228347 Sep 27 16:45:45.849207 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 530/1011] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:45 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1264 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:45:45.852945 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6207aa77-fd85-401d-8162-92b246d71785 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1722 microversion: 2.1 time: 0.227464 Sep 27 16:45:45.853724 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 482/1012] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:45 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:45:46.010573 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-50a551ea-000d-49a1-8a76-299a0ee125d3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:46.011810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-50a551ea-000d-49a1-8a76-299a0ee125d3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:46.017707 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50a551ea-000d-49a1-8a76-299a0ee125d3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:46.018185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50a551ea-000d-49a1-8a76-299a0ee125d3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:46.018616 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50a551ea-000d-49a1-8a76-299a0ee125d3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:46.019340 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50a551ea-000d-49a1-8a76-299a0ee125d3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:46.019788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50a551ea-000d-49a1-8a76-299a0ee125d3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:46.020207 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50a551ea-000d-49a1-8a76-299a0ee125d3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:46.154086 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-50a551ea-000d-49a1-8a76-299a0ee125d3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:46.161719 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-50a551ea-000d-49a1-8a76-299a0ee125d3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1571 microversion: 2.1 time: 0.155089 Sep 27 16:45:46.162278 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 531/1013] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:46 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:46.871798 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c16c9186-5ea2-46d8-b0fa-b3182aa89d70 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:46.872347 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c16c9186-5ea2-46d8-b0fa-b3182aa89d70 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:46.879006 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c16c9186-5ea2-46d8-b0fa-b3182aa89d70 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:46.879775 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c16c9186-5ea2-46d8-b0fa-b3182aa89d70 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:46.880030 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c16c9186-5ea2-46d8-b0fa-b3182aa89d70 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:46.880179 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1aa9e8a3-a469-4a19-985b-7ff5b5b999e4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:46.880673 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1aa9e8a3-a469-4a19-985b-7ff5b5b999e4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:46.880781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c16c9186-5ea2-46d8-b0fa-b3182aa89d70 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:46.881190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c16c9186-5ea2-46d8-b0fa-b3182aa89d70 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:46.881665 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c16c9186-5ea2-46d8-b0fa-b3182aa89d70 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:46.886749 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1aa9e8a3-a469-4a19-985b-7ff5b5b999e4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:46.887297 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1aa9e8a3-a469-4a19-985b-7ff5b5b999e4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:46.887771 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1aa9e8a3-a469-4a19-985b-7ff5b5b999e4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:46.888476 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1aa9e8a3-a469-4a19-985b-7ff5b5b999e4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:46.888953 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1aa9e8a3-a469-4a19-985b-7ff5b5b999e4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:46.889387 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1aa9e8a3-a469-4a19-985b-7ff5b5b999e4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:47.088401 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c16c9186-5ea2-46d8-b0fa-b3182aa89d70 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:47.092002 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1aa9e8a3-a469-4a19-985b-7ff5b5b999e4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:47.096841 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c16c9186-5ea2-46d8-b0fa-b3182aa89d70 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1264 microversion: 2.1 time: 0.229132 Sep 27 16:45:47.097858 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 483/1014] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:46 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1264 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:47.110395 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1aa9e8a3-a469-4a19-985b-7ff5b5b999e4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1722 microversion: 2.1 time: 0.224241 Sep 27 16:45:47.110395 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 532/1015] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:46 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:45:47.186099 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-88f50007-4275-486d-a198-06e5a090208f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:47.186638 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-88f50007-4275-486d-a198-06e5a090208f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:47.192737 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88f50007-4275-486d-a198-06e5a090208f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:47.193274 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88f50007-4275-486d-a198-06e5a090208f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:47.193688 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88f50007-4275-486d-a198-06e5a090208f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:47.194378 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88f50007-4275-486d-a198-06e5a090208f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:47.194859 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88f50007-4275-486d-a198-06e5a090208f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:47.195287 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88f50007-4275-486d-a198-06e5a090208f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:47.328411 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-88f50007-4275-486d-a198-06e5a090208f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:47.336869 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-88f50007-4275-486d-a198-06e5a090208f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1571 microversion: 2.1 time: 0.154072 Sep 27 16:45:47.337597 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 533/1016] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:47 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:48.121498 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a63f923f-4187-4eef-a35c-0b8c9e1abf90 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:48.121994 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a63f923f-4187-4eef-a35c-0b8c9e1abf90 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:48.124712 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-aa6f871b-bb69-44df-aff3-19005bbeb4c6 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:48.125329 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-aa6f871b-bb69-44df-aff3-19005bbeb4c6 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:48.128847 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a63f923f-4187-4eef-a35c-0b8c9e1abf90 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:48.129335 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a63f923f-4187-4eef-a35c-0b8c9e1abf90 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:48.129843 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a63f923f-4187-4eef-a35c-0b8c9e1abf90 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:48.130490 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a63f923f-4187-4eef-a35c-0b8c9e1abf90 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:48.130967 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a63f923f-4187-4eef-a35c-0b8c9e1abf90 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:48.131383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa6f871b-bb69-44df-aff3-19005bbeb4c6 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:48.131502 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a63f923f-4187-4eef-a35c-0b8c9e1abf90 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:48.131893 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa6f871b-bb69-44df-aff3-19005bbeb4c6 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:48.132330 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa6f871b-bb69-44df-aff3-19005bbeb4c6 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:48.133044 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa6f871b-bb69-44df-aff3-19005bbeb4c6 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:48.134204 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa6f871b-bb69-44df-aff3-19005bbeb4c6 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:48.134893 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa6f871b-bb69-44df-aff3-19005bbeb4c6 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:48.328918 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-aa6f871b-bb69-44df-aff3-19005bbeb4c6 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:48.337613 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-aa6f871b-bb69-44df-aff3-19005bbeb4c6 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1722 microversion: 2.1 time: 0.216551 Sep 27 16:45:48.337762 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a63f923f-4187-4eef-a35c-0b8c9e1abf90 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:48.338385 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 534/1017] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:48 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:48.350712 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a63f923f-4187-4eef-a35c-0b8c9e1abf90 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1450 microversion: 2.1 time: 0.233740 Sep 27 16:45:48.351314 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 484/1018] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:48 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1450 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:48.360694 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6c9eec2a-8b43-4802-801e-796b30c1f30e tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:48.361307 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6c9eec2a-8b43-4802-801e-796b30c1f30e tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:48.367071 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c9eec2a-8b43-4802-801e-796b30c1f30e tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:48.368093 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c9eec2a-8b43-4802-801e-796b30c1f30e tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:48.368822 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c9eec2a-8b43-4802-801e-796b30c1f30e tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:48.369527 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c9eec2a-8b43-4802-801e-796b30c1f30e tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:48.369986 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c9eec2a-8b43-4802-801e-796b30c1f30e tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:48.370412 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c9eec2a-8b43-4802-801e-796b30c1f30e tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:48.373760 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-eac9376d-64c2-4e9f-baf4-e2bfc6606380 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:48.374452 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-eac9376d-64c2-4e9f-baf4-e2bfc6606380 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:48.380425 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eac9376d-64c2-4e9f-baf4-e2bfc6606380 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:48.380912 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eac9376d-64c2-4e9f-baf4-e2bfc6606380 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:48.381348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eac9376d-64c2-4e9f-baf4-e2bfc6606380 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:48.382042 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eac9376d-64c2-4e9f-baf4-e2bfc6606380 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:48.382537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eac9376d-64c2-4e9f-baf4-e2bfc6606380 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:48.383941 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eac9376d-64c2-4e9f-baf4-e2bfc6606380 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:48.572862 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6c9eec2a-8b43-4802-801e-796b30c1f30e tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:48.576274 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-eac9376d-64c2-4e9f-baf4-e2bfc6606380 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:48.580606 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6c9eec2a-8b43-4802-801e-796b30c1f30e tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1571 microversion: 2.1 time: 0.223661 Sep 27 16:45:48.581176 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 535/1019] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:48 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1571 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:48.584190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-eac9376d-64c2-4e9f-baf4-e2bfc6606380 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1450 microversion: 2.1 time: 0.214351 Sep 27 16:45:48.584820 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 485/1020] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:48 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1450 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:45:49.360662 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9182eeeb-c33d-4c05-84d4-0121b036e865 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:49.361273 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9182eeeb-c33d-4c05-84d4-0121b036e865 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:49.367922 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9182eeeb-c33d-4c05-84d4-0121b036e865 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:49.368954 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9182eeeb-c33d-4c05-84d4-0121b036e865 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:49.369396 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9182eeeb-c33d-4c05-84d4-0121b036e865 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:49.370470 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9182eeeb-c33d-4c05-84d4-0121b036e865 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:49.370969 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9182eeeb-c33d-4c05-84d4-0121b036e865 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:49.371405 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9182eeeb-c33d-4c05-84d4-0121b036e865 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:49.550991 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9182eeeb-c33d-4c05-84d4-0121b036e865 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:49.560188 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9182eeeb-c33d-4c05-84d4-0121b036e865 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1722 microversion: 2.1 time: 0.203297 Sep 27 16:45:49.560761 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 536/1021] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:49 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:49.604380 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-327b43f7-d6de-4cc8-83db-55d3f88752df tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:49.604987 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-327b43f7-d6de-4cc8-83db-55d3f88752df tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:49.611562 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-327b43f7-d6de-4cc8-83db-55d3f88752df tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:49.612048 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-327b43f7-d6de-4cc8-83db-55d3f88752df tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:49.612509 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-327b43f7-d6de-4cc8-83db-55d3f88752df tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:49.613203 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-327b43f7-d6de-4cc8-83db-55d3f88752df tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:49.613663 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-327b43f7-d6de-4cc8-83db-55d3f88752df tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:49.614081 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-327b43f7-d6de-4cc8-83db-55d3f88752df tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:49.872058 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-327b43f7-d6de-4cc8-83db-55d3f88752df tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:49.879550 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-327b43f7-d6de-4cc8-83db-55d3f88752df tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1571 microversion: 2.1 time: 0.279098 Sep 27 16:45:49.880292 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 486/1022] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:49 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1571 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:50.583750 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-73f796a1-20bb-442b-a109-d3ef47f746c1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:50.584406 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-73f796a1-20bb-442b-a109-d3ef47f746c1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:50.590989 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-73f796a1-20bb-442b-a109-d3ef47f746c1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:50.591485 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-73f796a1-20bb-442b-a109-d3ef47f746c1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:50.591929 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-73f796a1-20bb-442b-a109-d3ef47f746c1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:50.592640 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-73f796a1-20bb-442b-a109-d3ef47f746c1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:50.593103 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-73f796a1-20bb-442b-a109-d3ef47f746c1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:50.593527 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-73f796a1-20bb-442b-a109-d3ef47f746c1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:50.810003 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-73f796a1-20bb-442b-a109-d3ef47f746c1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:50.818551 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-73f796a1-20bb-442b-a109-d3ef47f746c1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1722 microversion: 2.1 time: 0.238636 Sep 27 16:45:50.819189 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 537/1023] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:50 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:50.906375 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-58d6d450-932d-4db5-bef7-142b1f17a5b4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:50.907568 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-58d6d450-932d-4db5-bef7-142b1f17a5b4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:50.913470 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=57 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:50.915045 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-58d6d450-932d-4db5-bef7-142b1f17a5b4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:50.915551 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-58d6d450-932d-4db5-bef7-142b1f17a5b4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:50.916197 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-58d6d450-932d-4db5-bef7-142b1f17a5b4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:50.917073 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-58d6d450-932d-4db5-bef7-142b1f17a5b4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:50.917680 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-58d6d450-932d-4db5-bef7-142b1f17a5b4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:50.918254 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-58d6d450-932d-4db5-bef7-142b1f17a5b4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:51.120044 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-58d6d450-932d-4db5-bef7-142b1f17a5b4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:51.133586 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-58d6d450-932d-4db5-bef7-142b1f17a5b4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1571 microversion: 2.1 time: 0.225792 Sep 27 16:45:51.133586 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 487/1024] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:50 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1571 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:51.243562 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-6c9f781a-3337-4b24-9bcc-d369ae8663e7 req-fa36a7d5-8df6-4a6d-b620-64cd81cd4894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be9bfe87-9e1d-4f29-8d03-64ff185cce85", "tag": "de86fe62-fa12-4e70-a861-ea2d30bbe40e"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:45:51.253201 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-6c9f781a-3337-4b24-9bcc-d369ae8663e7 req-fa36a7d5-8df6-4a6d-b620-64cd81cd4894 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:51.253695 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-6c9f781a-3337-4b24-9bcc-d369ae8663e7 req-fa36a7d5-8df6-4a6d-b620-64cd81cd4894 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:51.254127 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-6c9f781a-3337-4b24-9bcc-d369ae8663e7 req-fa36a7d5-8df6-4a6d-b620-64cd81cd4894 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:51.266239 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-6c9f781a-3337-4b24-9bcc-d369ae8663e7 req-fa36a7d5-8df6-4a6d-b620-64cd81cd4894 service nova] Creating event network-changed:de86fe62-fa12-4e70-a861-ea2d30bbe40e for instance be9bfe87-9e1d-4f29-8d03-64ff185cce85 on hv-cinder-85506 Sep 27 16:45:51.285299 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-6c9f781a-3337-4b24-9bcc-d369ae8663e7 req-fa36a7d5-8df6-4a6d-b620-64cd81cd4894 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042371 Sep 27 16:45:51.285299 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 538/1025] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:45:51.843502 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e0ad4d8a-4644-4577-9510-b419b56d5c34 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:51.844113 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e0ad4d8a-4644-4577-9510-b419b56d5c34 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:51.850157 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0ad4d8a-4644-4577-9510-b419b56d5c34 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:51.850648 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0ad4d8a-4644-4577-9510-b419b56d5c34 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:51.851122 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0ad4d8a-4644-4577-9510-b419b56d5c34 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:51.852481 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0ad4d8a-4644-4577-9510-b419b56d5c34 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:51.853031 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0ad4d8a-4644-4577-9510-b419b56d5c34 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:51.853636 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0ad4d8a-4644-4577-9510-b419b56d5c34 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:52.002518 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e0ad4d8a-4644-4577-9510-b419b56d5c34 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:52.011667 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e0ad4d8a-4644-4577-9510-b419b56d5c34 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1699 microversion: 2.1 time: 0.171829 Sep 27 16:45:52.012108 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 488/1026] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:51 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1699 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:52.035736 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f975e2b5-05ec-41c4-b358-67e2ac25e855 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:45:52.049180 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f975e2b5-05ec-41c4-b358-67e2ac25e855 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:52.049180 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f975e2b5-05ec-41c4-b358-67e2ac25e855 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:52.049180 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f975e2b5-05ec-41c4-b358-67e2ac25e855 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:52.106912 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f975e2b5-05ec-41c4-b358-67e2ac25e855 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Going to try to start instance {{(pid=127618) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 27 16:45:52.154198 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c6ef4bc6-2843-482e-9c7f-0ceffa93aeca tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:52.155049 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c6ef4bc6-2843-482e-9c7f-0ceffa93aeca tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:52.161047 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c6ef4bc6-2843-482e-9c7f-0ceffa93aeca tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:52.161623 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c6ef4bc6-2843-482e-9c7f-0ceffa93aeca tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:52.162146 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c6ef4bc6-2843-482e-9c7f-0ceffa93aeca tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:52.162947 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c6ef4bc6-2843-482e-9c7f-0ceffa93aeca tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:52.163513 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c6ef4bc6-2843-482e-9c7f-0ceffa93aeca tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:52.163993 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c6ef4bc6-2843-482e-9c7f-0ceffa93aeca tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:52.299370 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c6ef4bc6-2843-482e-9c7f-0ceffa93aeca tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:52.307322 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c6ef4bc6-2843-482e-9c7f-0ceffa93aeca tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1571 microversion: 2.1 time: 0.159772 Sep 27 16:45:52.307902 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 489/1027] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:52 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:45:52.310802 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f975e2b5-05ec-41c4-b358-67e2ac25e855 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "POST /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e/action" status: 202 len: 0 microversion: 2.1 time: 0.279092 Sep 27 16:45:52.311409 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 539/1028] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Sep 27 16:45:52 2022] POST /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:45:52.319496 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cd95a602-e062-4ad2-98d0-ace9cb7661f4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:52.320104 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cd95a602-e062-4ad2-98d0-ace9cb7661f4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:52.332403 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd95a602-e062-4ad2-98d0-ace9cb7661f4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:52.333013 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd95a602-e062-4ad2-98d0-ace9cb7661f4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:52.333509 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd95a602-e062-4ad2-98d0-ace9cb7661f4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:52.334299 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd95a602-e062-4ad2-98d0-ace9cb7661f4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:52.334891 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd95a602-e062-4ad2-98d0-ace9cb7661f4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:52.335388 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd95a602-e062-4ad2-98d0-ace9cb7661f4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:52.467188 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-cd95a602-e062-4ad2-98d0-ace9cb7661f4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:52.475286 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-cd95a602-e062-4ad2-98d0-ace9cb7661f4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1708 microversion: 2.1 time: 0.159659 Sep 27 16:45:52.475855 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 490/1029] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:52 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1708 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:53.333578 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e1a0ffac-f361-4c69-ad98-65d954db24e1 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:53.334228 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e1a0ffac-f361-4c69-ad98-65d954db24e1 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:53.336830 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:53.341835 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e1a0ffac-f361-4c69-ad98-65d954db24e1 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:53.342323 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e1a0ffac-f361-4c69-ad98-65d954db24e1 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:53.342756 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e1a0ffac-f361-4c69-ad98-65d954db24e1 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:53.343473 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e1a0ffac-f361-4c69-ad98-65d954db24e1 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:53.343929 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e1a0ffac-f361-4c69-ad98-65d954db24e1 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:53.344356 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e1a0ffac-f361-4c69-ad98-65d954db24e1 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:53.498682 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dee1fc51-468f-4338-8f25-63d984ca8b94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:53.499337 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-dee1fc51-468f-4338-8f25-63d984ca8b94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:53.505767 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dee1fc51-468f-4338-8f25-63d984ca8b94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:53.506255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dee1fc51-468f-4338-8f25-63d984ca8b94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:53.506697 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dee1fc51-468f-4338-8f25-63d984ca8b94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:53.507422 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dee1fc51-468f-4338-8f25-63d984ca8b94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:53.508549 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dee1fc51-468f-4338-8f25-63d984ca8b94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:53.509139 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dee1fc51-468f-4338-8f25-63d984ca8b94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:53.526426 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e1a0ffac-f361-4c69-ad98-65d954db24e1 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:53.534117 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e1a0ffac-f361-4c69-ad98-65d954db24e1 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1571 microversion: 2.1 time: 0.204808 Sep 27 16:45:53.534707 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 540/1030] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:53 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1571 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:53.640372 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dee1fc51-468f-4338-8f25-63d984ca8b94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:53.649186 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-dee1fc51-468f-4338-8f25-63d984ca8b94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1708 microversion: 2.1 time: 0.153806 Sep 27 16:45:53.650011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 491/1031] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:53 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1708 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:45:54.557944 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c7c4d95a-bdb6-4c0c-a8a8-941dfdae03f1 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:54.558554 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c7c4d95a-bdb6-4c0c-a8a8-941dfdae03f1 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:54.564439 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c7c4d95a-bdb6-4c0c-a8a8-941dfdae03f1 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:54.564928 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c7c4d95a-bdb6-4c0c-a8a8-941dfdae03f1 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:54.565590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c7c4d95a-bdb6-4c0c-a8a8-941dfdae03f1 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:54.566292 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c7c4d95a-bdb6-4c0c-a8a8-941dfdae03f1 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:54.566740 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c7c4d95a-bdb6-4c0c-a8a8-941dfdae03f1 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:54.567452 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c7c4d95a-bdb6-4c0c-a8a8-941dfdae03f1 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:54.585808 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:54.673466 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-46f83126-2f86-4ade-8c9b-d24f327e0e64 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:54.674805 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-46f83126-2f86-4ade-8c9b-d24f327e0e64 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:54.681807 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46f83126-2f86-4ade-8c9b-d24f327e0e64 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:54.682300 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46f83126-2f86-4ade-8c9b-d24f327e0e64 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:54.682731 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46f83126-2f86-4ade-8c9b-d24f327e0e64 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:54.683450 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46f83126-2f86-4ade-8c9b-d24f327e0e64 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:54.683898 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46f83126-2f86-4ade-8c9b-d24f327e0e64 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:54.684317 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46f83126-2f86-4ade-8c9b-d24f327e0e64 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:54.703833 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:45:54.851038 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c7c4d95a-bdb6-4c0c-a8a8-941dfdae03f1 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:54.860505 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c7c4d95a-bdb6-4c0c-a8a8-941dfdae03f1 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1571 microversion: 2.1 time: 0.306782 Sep 27 16:45:54.861265 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 541/1032] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:54 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1571 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:54.920622 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-46f83126-2f86-4ade-8c9b-d24f327e0e64 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:54.930291 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-46f83126-2f86-4ade-8c9b-d24f327e0e64 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1708 microversion: 2.1 time: 0.260572 Sep 27 16:45:54.931072 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 492/1033] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:54 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1708 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:45:55.883677 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c7b52479-affd-41e8-9b7d-db0763b7b4f3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:55.885104 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c7b52479-affd-41e8-9b7d-db0763b7b4f3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:55.891718 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c7b52479-affd-41e8-9b7d-db0763b7b4f3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:55.892202 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c7b52479-affd-41e8-9b7d-db0763b7b4f3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:55.892638 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c7b52479-affd-41e8-9b7d-db0763b7b4f3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:55.893381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c7b52479-affd-41e8-9b7d-db0763b7b4f3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:55.893833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c7b52479-affd-41e8-9b7d-db0763b7b4f3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:55.894258 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c7b52479-affd-41e8-9b7d-db0763b7b4f3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:55.954175 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-529b43ee-8928-4677-9618-dd8ea9ca0871 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:55.954803 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-529b43ee-8928-4677-9618-dd8ea9ca0871 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:55.961714 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-529b43ee-8928-4677-9618-dd8ea9ca0871 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:55.962208 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-529b43ee-8928-4677-9618-dd8ea9ca0871 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:55.962641 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-529b43ee-8928-4677-9618-dd8ea9ca0871 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:55.963737 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-529b43ee-8928-4677-9618-dd8ea9ca0871 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:55.964355 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-529b43ee-8928-4677-9618-dd8ea9ca0871 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:55.964781 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-529b43ee-8928-4677-9618-dd8ea9ca0871 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:56.083948 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c7b52479-affd-41e8-9b7d-db0763b7b4f3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:56.092123 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c7b52479-affd-41e8-9b7d-db0763b7b4f3 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1571 microversion: 2.1 time: 0.212224 Sep 27 16:45:56.096319 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 542/1034] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:55 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1571 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:56.130656 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-529b43ee-8928-4677-9618-dd8ea9ca0871 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:56.139008 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-529b43ee-8928-4677-9618-dd8ea9ca0871 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1708 microversion: 2.1 time: 0.189017 Sep 27 16:45:56.139571 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 493/1035] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:55 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1708 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:57.117061 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6e83ccb6-a507-4357-bcd7-d982b99c5f77 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:57.117673 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6e83ccb6-a507-4357-bcd7-d982b99c5f77 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:57.126962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e83ccb6-a507-4357-bcd7-d982b99c5f77 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:57.127449 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e83ccb6-a507-4357-bcd7-d982b99c5f77 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:57.127886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e83ccb6-a507-4357-bcd7-d982b99c5f77 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:57.128580 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e83ccb6-a507-4357-bcd7-d982b99c5f77 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:57.129030 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e83ccb6-a507-4357-bcd7-d982b99c5f77 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:57.129483 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e83ccb6-a507-4357-bcd7-d982b99c5f77 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:57.163570 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4abb6a22-b453-4ffe-812f-8be836f3614f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:57.164311 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4abb6a22-b453-4ffe-812f-8be836f3614f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:57.171128 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4abb6a22-b453-4ffe-812f-8be836f3614f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:57.171705 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4abb6a22-b453-4ffe-812f-8be836f3614f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:57.172204 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4abb6a22-b453-4ffe-812f-8be836f3614f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:57.172933 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4abb6a22-b453-4ffe-812f-8be836f3614f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:57.173385 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4abb6a22-b453-4ffe-812f-8be836f3614f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:57.174013 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4abb6a22-b453-4ffe-812f-8be836f3614f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:57.325521 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6e83ccb6-a507-4357-bcd7-d982b99c5f77 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:57.343430 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6e83ccb6-a507-4357-bcd7-d982b99c5f77 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1571 microversion: 2.1 time: 0.230712 Sep 27 16:45:57.345244 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 543/1036] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:57 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1571 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:57.371264 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4abb6a22-b453-4ffe-812f-8be836f3614f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:57.379793 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4abb6a22-b453-4ffe-812f-8be836f3614f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1708 microversion: 2.1 time: 0.220293 Sep 27 16:45:57.380377 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 494/1037] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:57 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1708 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:45:58.369556 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3f10616a-e9fe-46bc-8f26-4ac917e698ba tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:58.370185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3f10616a-e9fe-46bc-8f26-4ac917e698ba tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:58.376245 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f10616a-e9fe-46bc-8f26-4ac917e698ba tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:58.376733 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f10616a-e9fe-46bc-8f26-4ac917e698ba tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:58.377344 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f10616a-e9fe-46bc-8f26-4ac917e698ba tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:58.377855 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f10616a-e9fe-46bc-8f26-4ac917e698ba tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:58.378312 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f10616a-e9fe-46bc-8f26-4ac917e698ba tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:58.378737 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f10616a-e9fe-46bc-8f26-4ac917e698ba tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:58.406588 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-eb2fa6c5-ffe6-4d37-af2b-8f32f8af64dc tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:58.407323 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-eb2fa6c5-ffe6-4d37-af2b-8f32f8af64dc tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:58.414311 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eb2fa6c5-ffe6-4d37-af2b-8f32f8af64dc tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:58.414828 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eb2fa6c5-ffe6-4d37-af2b-8f32f8af64dc tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:58.415268 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eb2fa6c5-ffe6-4d37-af2b-8f32f8af64dc tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:58.416005 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eb2fa6c5-ffe6-4d37-af2b-8f32f8af64dc tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:58.416487 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eb2fa6c5-ffe6-4d37-af2b-8f32f8af64dc tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:58.416905 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eb2fa6c5-ffe6-4d37-af2b-8f32f8af64dc tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:58.568449 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3f10616a-e9fe-46bc-8f26-4ac917e698ba tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:58.578156 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3f10616a-e9fe-46bc-8f26-4ac917e698ba tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1572 microversion: 2.1 time: 0.212368 Sep 27 16:45:58.578887 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 544/1038] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:58 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1572 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:45:58.600856 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-63add190-2318-4569-be19-9ae43000015f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:45:58.601539 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-63add190-2318-4569-be19-9ae43000015f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:58.601705 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-eb2fa6c5-ffe6-4d37-af2b-8f32f8af64dc tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:58.607879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63add190-2318-4569-be19-9ae43000015f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:58.608375 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63add190-2318-4569-be19-9ae43000015f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:58.608992 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63add190-2318-4569-be19-9ae43000015f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:58.609879 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63add190-2318-4569-be19-9ae43000015f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:58.610343 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63add190-2318-4569-be19-9ae43000015f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:58.610805 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63add190-2318-4569-be19-9ae43000015f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:58.614220 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-eb2fa6c5-ffe6-4d37-af2b-8f32f8af64dc tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1712 microversion: 2.1 time: 0.211435 Sep 27 16:45:58.614830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 495/1039] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:58 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1712 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:45:58.656366 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-63add190-2318-4569-be19-9ae43000015f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127618) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 27 16:45:58.988550 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-63add190-2318-4569-be19-9ae43000015f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "POST /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268/action" status: 202 len: 0 microversion: 2.1 time: 0.391432 Sep 27 16:45:58.989154 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 545/1040] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Sep 27 16:45:58 2022] POST /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 16:45:58.998404 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1ee34f0c-a7ab-4f9c-b611-61561611e0ae tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:45:58.998980 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1ee34f0c-a7ab-4f9c-b611-61561611e0ae tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:45:59.004950 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1ee34f0c-a7ab-4f9c-b611-61561611e0ae tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:59.005451 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1ee34f0c-a7ab-4f9c-b611-61561611e0ae tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:59.005886 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1ee34f0c-a7ab-4f9c-b611-61561611e0ae tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:59.006625 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1ee34f0c-a7ab-4f9c-b611-61561611e0ae tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:45:59.007481 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1ee34f0c-a7ab-4f9c-b611-61561611e0ae tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:45:59.007922 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1ee34f0c-a7ab-4f9c-b611-61561611e0ae tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:45:59.144086 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1ee34f0c-a7ab-4f9c-b611-61561611e0ae tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:45:59.152343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1ee34f0c-a7ab-4f9c-b611-61561611e0ae tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1520 microversion: 2.1 time: 0.158957 Sep 27 16:45:59.153330 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 496/1041] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:45:58 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:00.176077 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a4f28bda-21fe-426e-974c-24b73e8e56d2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:00.176722 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a4f28bda-21fe-426e-974c-24b73e8e56d2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:00.184477 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a4f28bda-21fe-426e-974c-24b73e8e56d2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:00.185136 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a4f28bda-21fe-426e-974c-24b73e8e56d2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:00.185582 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a4f28bda-21fe-426e-974c-24b73e8e56d2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:00.186321 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a4f28bda-21fe-426e-974c-24b73e8e56d2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:00.186831 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a4f28bda-21fe-426e-974c-24b73e8e56d2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:00.187266 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a4f28bda-21fe-426e-974c-24b73e8e56d2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:00.324321 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a4f28bda-21fe-426e-974c-24b73e8e56d2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:00.332263 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a4f28bda-21fe-426e-974c-24b73e8e56d2 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1522 microversion: 2.1 time: 0.160017 Sep 27 16:46:00.337506 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 546/1042] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:00 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:01.357569 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-026f9ed4-3b3b-43d1-8086-dac4d76f64d9 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:01.359188 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-026f9ed4-3b3b-43d1-8086-dac4d76f64d9 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:01.366021 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-026f9ed4-3b3b-43d1-8086-dac4d76f64d9 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:01.366552 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-026f9ed4-3b3b-43d1-8086-dac4d76f64d9 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:01.367387 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-026f9ed4-3b3b-43d1-8086-dac4d76f64d9 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:01.368304 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-026f9ed4-3b3b-43d1-8086-dac4d76f64d9 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:01.369660 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-026f9ed4-3b3b-43d1-8086-dac4d76f64d9 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:01.370285 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-026f9ed4-3b3b-43d1-8086-dac4d76f64d9 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:01.393100 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-5a45fdf2-bfce-4763-88c7-92a8b1c2f7e5 req-e3fb2e6f-d07c-40eb-9b8b-d53889e736e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800233b1-cc79-4eb5-9cdf-ff21e8321268", "name": "network-vif-unplugged", "status": "completed", "tag": "c6777043-34a8-4a48-b945-7f80df4e0022"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:46:01.410310 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-5a45fdf2-bfce-4763-88c7-92a8b1c2f7e5 req-e3fb2e6f-d07c-40eb-9b8b-d53889e736e5 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:01.410821 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-5a45fdf2-bfce-4763-88c7-92a8b1c2f7e5 req-e3fb2e6f-d07c-40eb-9b8b-d53889e736e5 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:01.411261 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-5a45fdf2-bfce-4763-88c7-92a8b1c2f7e5 req-e3fb2e6f-d07c-40eb-9b8b-d53889e736e5 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:01.570739 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-026f9ed4-3b3b-43d1-8086-dac4d76f64d9 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:01.581221 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-026f9ed4-3b3b-43d1-8086-dac4d76f64d9 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1578 microversion: 2.1 time: 0.228404 Sep 27 16:46:01.595047 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 497/1043] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:01 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1578 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:01.621623 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-5a45fdf2-bfce-4763-88c7-92a8b1c2f7e5 req-e3fb2e6f-d07c-40eb-9b8b-d53889e736e5 service nova] Creating event network-vif-unplugged:c6777043-34a8-4a48-b945-7f80df4e0022 for instance 800233b1-cc79-4eb5-9cdf-ff21e8321268 on hv-cinder-85506 Sep 27 16:46:01.626634 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-5a45fdf2-bfce-4763-88c7-92a8b1c2f7e5 req-e3fb2e6f-d07c-40eb-9b8b-d53889e736e5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.237363 Sep 27 16:46:01.627263 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 547/1044] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:46:02.605838 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e95cb1fc-e53a-43f7-a01b-1c7b2f34094f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:02.606446 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e95cb1fc-e53a-43f7-a01b-1c7b2f34094f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:02.612861 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e95cb1fc-e53a-43f7-a01b-1c7b2f34094f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:02.613339 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e95cb1fc-e53a-43f7-a01b-1c7b2f34094f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:02.613769 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e95cb1fc-e53a-43f7-a01b-1c7b2f34094f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:02.614458 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e95cb1fc-e53a-43f7-a01b-1c7b2f34094f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:02.614940 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e95cb1fc-e53a-43f7-a01b-1c7b2f34094f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:02.615359 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e95cb1fc-e53a-43f7-a01b-1c7b2f34094f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:02.750802 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e95cb1fc-e53a-43f7-a01b-1c7b2f34094f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:02.752249 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e95cb1fc-e53a-43f7-a01b-1c7b2f34094f tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1578 microversion: 2.1 time: 0.150328 Sep 27 16:46:02.752820 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 498/1045] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:02 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:03.777235 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-060fdf4a-cb6d-41bd-89c8-65b04a2a71f4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:03.777927 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-060fdf4a-cb6d-41bd-89c8-65b04a2a71f4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:03.784413 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-060fdf4a-cb6d-41bd-89c8-65b04a2a71f4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:03.784890 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-060fdf4a-cb6d-41bd-89c8-65b04a2a71f4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:03.786401 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-060fdf4a-cb6d-41bd-89c8-65b04a2a71f4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:03.787221 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-060fdf4a-cb6d-41bd-89c8-65b04a2a71f4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:03.787695 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-060fdf4a-cb6d-41bd-89c8-65b04a2a71f4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:03.788161 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-060fdf4a-cb6d-41bd-89c8-65b04a2a71f4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:03.923471 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-060fdf4a-cb6d-41bd-89c8-65b04a2a71f4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:03.931324 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-060fdf4a-cb6d-41bd-89c8-65b04a2a71f4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1578 microversion: 2.1 time: 0.159002 Sep 27 16:46:03.932010 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 548/1046] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:03 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:04.955003 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1c089afc-b0ab-447c-9d61-bc51234a0a39 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:04.955615 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1c089afc-b0ab-447c-9d61-bc51234a0a39 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:04.962496 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c089afc-b0ab-447c-9d61-bc51234a0a39 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:04.963011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c089afc-b0ab-447c-9d61-bc51234a0a39 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:04.963445 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c089afc-b0ab-447c-9d61-bc51234a0a39 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:04.964133 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c089afc-b0ab-447c-9d61-bc51234a0a39 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:04.964586 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c089afc-b0ab-447c-9d61-bc51234a0a39 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:04.965008 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1c089afc-b0ab-447c-9d61-bc51234a0a39 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:05.093111 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1c089afc-b0ab-447c-9d61-bc51234a0a39 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:05.100783 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1c089afc-b0ab-447c-9d61-bc51234a0a39 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1578 microversion: 2.1 time: 0.149748 Sep 27 16:46:05.101347 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 499/1047] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:04 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:46:06.132919 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4daf8b6d-65ba-4bde-b6d9-b9ff4f1fdcb8 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:06.133564 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4daf8b6d-65ba-4bde-b6d9-b9ff4f1fdcb8 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:06.139578 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4daf8b6d-65ba-4bde-b6d9-b9ff4f1fdcb8 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:06.140080 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4daf8b6d-65ba-4bde-b6d9-b9ff4f1fdcb8 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:06.140510 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4daf8b6d-65ba-4bde-b6d9-b9ff4f1fdcb8 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:06.141187 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4daf8b6d-65ba-4bde-b6d9-b9ff4f1fdcb8 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:06.141636 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4daf8b6d-65ba-4bde-b6d9-b9ff4f1fdcb8 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:06.142052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4daf8b6d-65ba-4bde-b6d9-b9ff4f1fdcb8 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:06.271406 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4daf8b6d-65ba-4bde-b6d9-b9ff4f1fdcb8 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:06.279540 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4daf8b6d-65ba-4bde-b6d9-b9ff4f1fdcb8 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1578 microversion: 2.1 time: 0.150460 Sep 27 16:46:06.280125 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 549/1048] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:06 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:07.303461 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0c6cf435-5b39-4c35-ade4-d5044c976fcb tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:07.304001 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0c6cf435-5b39-4c35-ade4-d5044c976fcb tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:07.311176 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c6cf435-5b39-4c35-ade4-d5044c976fcb tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:07.311689 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c6cf435-5b39-4c35-ade4-d5044c976fcb tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:07.312128 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c6cf435-5b39-4c35-ade4-d5044c976fcb tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:07.312821 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c6cf435-5b39-4c35-ade4-d5044c976fcb tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:07.313274 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c6cf435-5b39-4c35-ade4-d5044c976fcb tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:07.313695 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c6cf435-5b39-4c35-ade4-d5044c976fcb tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:07.448815 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0c6cf435-5b39-4c35-ade4-d5044c976fcb tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:07.456565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0c6cf435-5b39-4c35-ade4-d5044c976fcb tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1578 microversion: 2.1 time: 0.157102 Sep 27 16:46:07.457137 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 500/1049] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:07 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:08.480225 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e8dabe72-756e-4c19-b85d-cd61f68ab889 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:08.480761 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e8dabe72-756e-4c19-b85d-cd61f68ab889 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:08.486758 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8dabe72-756e-4c19-b85d-cd61f68ab889 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:08.487274 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8dabe72-756e-4c19-b85d-cd61f68ab889 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:08.487705 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8dabe72-756e-4c19-b85d-cd61f68ab889 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:08.488395 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8dabe72-756e-4c19-b85d-cd61f68ab889 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:08.488847 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8dabe72-756e-4c19-b85d-cd61f68ab889 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:08.489269 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8dabe72-756e-4c19-b85d-cd61f68ab889 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:08.616874 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e8dabe72-756e-4c19-b85d-cd61f68ab889 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:08.625073 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e8dabe72-756e-4c19-b85d-cd61f68ab889 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1578 microversion: 2.1 time: 0.149269 Sep 27 16:46:08.625639 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 550/1050] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:08 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:09.648429 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2107365b-5130-422f-a347-7b42150790fe tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:09.649047 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2107365b-5130-422f-a347-7b42150790fe tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:09.656836 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2107365b-5130-422f-a347-7b42150790fe tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:09.657143 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2107365b-5130-422f-a347-7b42150790fe tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:09.657469 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2107365b-5130-422f-a347-7b42150790fe tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:09.658134 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2107365b-5130-422f-a347-7b42150790fe tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:09.658530 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2107365b-5130-422f-a347-7b42150790fe tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:09.658955 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2107365b-5130-422f-a347-7b42150790fe tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:10.067635 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2107365b-5130-422f-a347-7b42150790fe tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:10.076549 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2107365b-5130-422f-a347-7b42150790fe tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1578 microversion: 2.1 time: 0.432039 Sep 27 16:46:10.077122 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 501/1051] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:09 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1578 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:11.099990 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f3f248ae-ddb1-408e-88c4-9bff526a519c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:11.100599 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f3f248ae-ddb1-408e-88c4-9bff526a519c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:11.107308 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3f248ae-ddb1-408e-88c4-9bff526a519c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:11.107792 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3f248ae-ddb1-408e-88c4-9bff526a519c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:11.108230 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3f248ae-ddb1-408e-88c4-9bff526a519c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:11.108924 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3f248ae-ddb1-408e-88c4-9bff526a519c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:11.109381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3f248ae-ddb1-408e-88c4-9bff526a519c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:11.109808 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3f248ae-ddb1-408e-88c4-9bff526a519c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:11.240520 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f3f248ae-ddb1-408e-88c4-9bff526a519c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:11.248131 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f3f248ae-ddb1-408e-88c4-9bff526a519c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1578 microversion: 2.1 time: 0.152000 Sep 27 16:46:11.250804 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 551/1052] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:11 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:12.271102 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cf8702c3-9356-43f2-a7aa-a659bbdc227a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:12.271745 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cf8702c3-9356-43f2-a7aa-a659bbdc227a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:12.278720 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf8702c3-9356-43f2-a7aa-a659bbdc227a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:12.279231 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf8702c3-9356-43f2-a7aa-a659bbdc227a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:12.279674 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf8702c3-9356-43f2-a7aa-a659bbdc227a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:12.280365 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf8702c3-9356-43f2-a7aa-a659bbdc227a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:12.280819 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf8702c3-9356-43f2-a7aa-a659bbdc227a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:12.281243 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf8702c3-9356-43f2-a7aa-a659bbdc227a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:12.413464 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-cf8702c3-9356-43f2-a7aa-a659bbdc227a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:12.422172 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-cf8702c3-9356-43f2-a7aa-a659bbdc227a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1578 microversion: 2.1 time: 0.155022 Sep 27 16:46:12.422746 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 502/1053] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:12 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:13.445532 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0a49a6d5-aaf2-46dd-96e8-b9f05ddbe6af tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:13.446234 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0a49a6d5-aaf2-46dd-96e8-b9f05ddbe6af tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:13.453208 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0a49a6d5-aaf2-46dd-96e8-b9f05ddbe6af tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:13.453683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0a49a6d5-aaf2-46dd-96e8-b9f05ddbe6af tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:13.454151 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0a49a6d5-aaf2-46dd-96e8-b9f05ddbe6af tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:13.454891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0a49a6d5-aaf2-46dd-96e8-b9f05ddbe6af tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:13.455353 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0a49a6d5-aaf2-46dd-96e8-b9f05ddbe6af tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:13.455794 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0a49a6d5-aaf2-46dd-96e8-b9f05ddbe6af tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:13.463303 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-4a290c76-4200-443a-875a-f32a60b082db req-47933817-8e6d-4c17-a970-7ea6921688c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800233b1-cc79-4eb5-9cdf-ff21e8321268", "name": "network-vif-plugged", "status": "completed", "tag": "c6777043-34a8-4a48-b945-7f80df4e0022"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:46:13.475105 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-4a290c76-4200-443a-875a-f32a60b082db req-47933817-8e6d-4c17-a970-7ea6921688c7 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:13.475612 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-4a290c76-4200-443a-875a-f32a60b082db req-47933817-8e6d-4c17-a970-7ea6921688c7 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:13.476067 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-4a290c76-4200-443a-875a-f32a60b082db req-47933817-8e6d-4c17-a970-7ea6921688c7 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:13.487189 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-4a290c76-4200-443a-875a-f32a60b082db req-47933817-8e6d-4c17-a970-7ea6921688c7 service nova] Creating event network-vif-plugged:c6777043-34a8-4a48-b945-7f80df4e0022 for instance 800233b1-cc79-4eb5-9cdf-ff21e8321268 on hv-cinder-85506 Sep 27 16:46:13.493192 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-4a290c76-4200-443a-875a-f32a60b082db req-47933817-8e6d-4c17-a970-7ea6921688c7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034794 Sep 27 16:46:13.495696 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 503/1054] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:46:13.594438 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0a49a6d5-aaf2-46dd-96e8-b9f05ddbe6af tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:13.603136 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0a49a6d5-aaf2-46dd-96e8-b9f05ddbe6af tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1578 microversion: 2.1 time: 0.161456 Sep 27 16:46:13.604230 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 552/1055] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:13 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:14.626946 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4aa2bc71-defa-4f66-9d6a-4e03d32ffb7c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:14.627671 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4aa2bc71-defa-4f66-9d6a-4e03d32ffb7c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:14.634193 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4aa2bc71-defa-4f66-9d6a-4e03d32ffb7c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:14.634666 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4aa2bc71-defa-4f66-9d6a-4e03d32ffb7c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:14.635642 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4aa2bc71-defa-4f66-9d6a-4e03d32ffb7c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:14.636505 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4aa2bc71-defa-4f66-9d6a-4e03d32ffb7c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:14.636957 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4aa2bc71-defa-4f66-9d6a-4e03d32ffb7c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:14.637375 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4aa2bc71-defa-4f66-9d6a-4e03d32ffb7c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:14.773369 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4aa2bc71-defa-4f66-9d6a-4e03d32ffb7c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:14.781600 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4aa2bc71-defa-4f66-9d6a-4e03d32ffb7c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1578 microversion: 2.1 time: 0.158960 Sep 27 16:46:14.782367 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 504/1056] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:14 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:15.805680 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0fb19430-6f0d-4bd4-955d-fa1cd7d9a42c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:15.806379 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0fb19430-6f0d-4bd4-955d-fa1cd7d9a42c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:15.813155 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0fb19430-6f0d-4bd4-955d-fa1cd7d9a42c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:15.813657 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0fb19430-6f0d-4bd4-955d-fa1cd7d9a42c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:15.814108 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0fb19430-6f0d-4bd4-955d-fa1cd7d9a42c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:15.814842 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0fb19430-6f0d-4bd4-955d-fa1cd7d9a42c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:15.815306 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0fb19430-6f0d-4bd4-955d-fa1cd7d9a42c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:15.815736 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0fb19430-6f0d-4bd4-955d-fa1cd7d9a42c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:15.955007 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0fb19430-6f0d-4bd4-955d-fa1cd7d9a42c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:15.962687 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0fb19430-6f0d-4bd4-955d-fa1cd7d9a42c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1565 microversion: 2.1 time: 0.160974 Sep 27 16:46:15.963993 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 553/1057] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:15 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:32.019869 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e2d6b043-4adc-428f-a2ca-add0d7b4fe9c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:32.020464 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e2d6b043-4adc-428f-a2ca-add0d7b4fe9c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:32.023037 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=35 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:46:32.023990 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=70 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:46:32.028643 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2d6b043-4adc-428f-a2ca-add0d7b4fe9c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:32.029189 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2d6b043-4adc-428f-a2ca-add0d7b4fe9c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:32.029655 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2d6b043-4adc-428f-a2ca-add0d7b4fe9c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:32.030439 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2d6b043-4adc-428f-a2ca-add0d7b4fe9c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:32.031030 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2d6b043-4adc-428f-a2ca-add0d7b4fe9c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:32.031460 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2d6b043-4adc-428f-a2ca-add0d7b4fe9c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:32.316865 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-e2d6b043-4adc-428f-a2ca-add0d7b4fe9c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lazy-loading 'services' on Instance uuid 23412d14-1e6d-4792-b23b-591d19c2bd7e {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:46:32.556136 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e2d6b043-4adc-428f-a2ca-add0d7b4fe9c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "DELETE /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e/os-volume_attachments/db19b5b3-d27a-4a50-bedc-81fc6625fcea" status: 202 len: 0 microversion: 2.1 time: 0.540015 Sep 27 16:46:32.556723 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 505/1058] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Sep 27 16:46:32 2022] DELETE /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e/os-volume_attachments/db19b5b3-d27a-4a50-bedc-81fc6625fcea => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:46:33.678830 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d37ef41f-2daa-4467-a05c-0f168219b27d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:46:33.682000 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:46:33.682000 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:46:33.686545 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d37ef41f-2daa-4467-a05c-0f168219b27d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:33.687059 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d37ef41f-2daa-4467-a05c-0f168219b27d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:33.687499 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d37ef41f-2daa-4467-a05c-0f168219b27d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:33.709700 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d37ef41f-2daa-4467-a05c-0f168219b27d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Going to try to stop instance {{(pid=127618) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 27 16:46:33.931672 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d37ef41f-2daa-4467-a05c-0f168219b27d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "POST /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e/action" status: 202 len: 0 microversion: 2.1 time: 0.257524 Sep 27 16:46:33.932268 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 554/1059] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Sep 27 16:46:33 2022] POST /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:46:33.942119 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3722927b-fde8-4b9c-afe6-5fad64b6f5f2 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:33.942880 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3722927b-fde8-4b9c-afe6-5fad64b6f5f2 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:33.949414 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3722927b-fde8-4b9c-afe6-5fad64b6f5f2 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:33.949907 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3722927b-fde8-4b9c-afe6-5fad64b6f5f2 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:33.950358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3722927b-fde8-4b9c-afe6-5fad64b6f5f2 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:33.951100 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3722927b-fde8-4b9c-afe6-5fad64b6f5f2 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:33.951642 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3722927b-fde8-4b9c-afe6-5fad64b6f5f2 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:33.952191 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3722927b-fde8-4b9c-afe6-5fad64b6f5f2 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:34.082394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3722927b-fde8-4b9c-afe6-5fad64b6f5f2 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:34.090983 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3722927b-fde8-4b9c-afe6-5fad64b6f5f2 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1676 microversion: 2.1 time: 0.153598 Sep 27 16:46:34.091558 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 506/1060] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:33 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:35.115378 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cd5044c8-9782-44ed-9022-5e9faf6ecbb0 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:35.116070 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cd5044c8-9782-44ed-9022-5e9faf6ecbb0 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:35.122839 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd5044c8-9782-44ed-9022-5e9faf6ecbb0 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:35.123829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd5044c8-9782-44ed-9022-5e9faf6ecbb0 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:35.124271 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd5044c8-9782-44ed-9022-5e9faf6ecbb0 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:35.124951 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd5044c8-9782-44ed-9022-5e9faf6ecbb0 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:35.125397 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd5044c8-9782-44ed-9022-5e9faf6ecbb0 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:35.125816 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd5044c8-9782-44ed-9022-5e9faf6ecbb0 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:35.357539 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cd5044c8-9782-44ed-9022-5e9faf6ecbb0 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:35.365783 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cd5044c8-9782-44ed-9022-5e9faf6ecbb0 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1676 microversion: 2.1 time: 0.254624 Sep 27 16:46:35.366287 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 555/1061] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:35 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1676 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:36.390280 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d2e2bac9-3f18-462a-b4fa-07d1271526e2 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:36.390795 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d2e2bac9-3f18-462a-b4fa-07d1271526e2 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:36.397740 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2e2bac9-3f18-462a-b4fa-07d1271526e2 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:36.403283 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2e2bac9-3f18-462a-b4fa-07d1271526e2 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:36.403283 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2e2bac9-3f18-462a-b4fa-07d1271526e2 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:36.403283 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2e2bac9-3f18-462a-b4fa-07d1271526e2 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:36.403283 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2e2bac9-3f18-462a-b4fa-07d1271526e2 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:36.403701 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2e2bac9-3f18-462a-b4fa-07d1271526e2 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:36.532538 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d2e2bac9-3f18-462a-b4fa-07d1271526e2 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:36.540295 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d2e2bac9-3f18-462a-b4fa-07d1271526e2 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1676 microversion: 2.1 time: 0.154689 Sep 27 16:46:36.540867 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 507/1062] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:36 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:37.563904 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a8aa2c1f-d52c-4d09-8ac2-696e70f9cee3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:37.564518 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a8aa2c1f-d52c-4d09-8ac2-696e70f9cee3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:37.570430 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8aa2c1f-d52c-4d09-8ac2-696e70f9cee3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:37.570959 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8aa2c1f-d52c-4d09-8ac2-696e70f9cee3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:37.571397 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8aa2c1f-d52c-4d09-8ac2-696e70f9cee3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:37.572094 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8aa2c1f-d52c-4d09-8ac2-696e70f9cee3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:37.572551 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8aa2c1f-d52c-4d09-8ac2-696e70f9cee3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:37.572978 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8aa2c1f-d52c-4d09-8ac2-696e70f9cee3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:37.699029 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a8aa2c1f-d52c-4d09-8ac2-696e70f9cee3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:37.707265 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a8aa2c1f-d52c-4d09-8ac2-696e70f9cee3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1676 microversion: 2.1 time: 0.148070 Sep 27 16:46:37.707832 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 556/1063] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:37 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:38.731408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-90d432e5-d151-43ab-8d7f-5ceabc433bf5 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:38.732049 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-90d432e5-d151-43ab-8d7f-5ceabc433bf5 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:38.740069 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90d432e5-d151-43ab-8d7f-5ceabc433bf5 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:38.740069 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90d432e5-d151-43ab-8d7f-5ceabc433bf5 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:38.740069 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90d432e5-d151-43ab-8d7f-5ceabc433bf5 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:38.740749 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90d432e5-d151-43ab-8d7f-5ceabc433bf5 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:38.741686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90d432e5-d151-43ab-8d7f-5ceabc433bf5 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:38.741686 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90d432e5-d151-43ab-8d7f-5ceabc433bf5 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:38.870497 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-90d432e5-d151-43ab-8d7f-5ceabc433bf5 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:38.878398 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-90d432e5-d151-43ab-8d7f-5ceabc433bf5 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1676 microversion: 2.1 time: 0.150963 Sep 27 16:46:38.878987 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 508/1064] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:38 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:39.904072 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-46d89afe-b982-4fed-a284-6790ad7d8003 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:39.904072 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-46d89afe-b982-4fed-a284-6790ad7d8003 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:39.908495 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46d89afe-b982-4fed-a284-6790ad7d8003 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:39.909154 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46d89afe-b982-4fed-a284-6790ad7d8003 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:39.909422 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46d89afe-b982-4fed-a284-6790ad7d8003 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:39.910114 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46d89afe-b982-4fed-a284-6790ad7d8003 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:39.910706 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46d89afe-b982-4fed-a284-6790ad7d8003 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:39.911173 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46d89afe-b982-4fed-a284-6790ad7d8003 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:40.040937 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-46d89afe-b982-4fed-a284-6790ad7d8003 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:40.049109 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-46d89afe-b982-4fed-a284-6790ad7d8003 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1676 microversion: 2.1 time: 0.151460 Sep 27 16:46:40.049666 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 557/1065] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:39 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:41.072571 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b8fe38b3-5a4b-4683-aa8c-d4c07ef5b02b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:41.073182 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b8fe38b3-5a4b-4683-aa8c-d4c07ef5b02b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:41.079618 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8fe38b3-5a4b-4683-aa8c-d4c07ef5b02b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:41.080101 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8fe38b3-5a4b-4683-aa8c-d4c07ef5b02b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:41.080536 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8fe38b3-5a4b-4683-aa8c-d4c07ef5b02b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:41.081225 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8fe38b3-5a4b-4683-aa8c-d4c07ef5b02b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:41.081675 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8fe38b3-5a4b-4683-aa8c-d4c07ef5b02b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:41.082094 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8fe38b3-5a4b-4683-aa8c-d4c07ef5b02b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:41.211282 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b8fe38b3-5a4b-4683-aa8c-d4c07ef5b02b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:41.219731 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b8fe38b3-5a4b-4683-aa8c-d4c07ef5b02b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1676 microversion: 2.1 time: 0.151001 Sep 27 16:46:41.220321 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 509/1066] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:41 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:42.242710 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-88deca49-756a-45ec-9728-504476d28027 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:42.243321 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-88deca49-756a-45ec-9728-504476d28027 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:42.249263 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88deca49-756a-45ec-9728-504476d28027 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:42.249746 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88deca49-756a-45ec-9728-504476d28027 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:42.250181 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88deca49-756a-45ec-9728-504476d28027 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:42.250902 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88deca49-756a-45ec-9728-504476d28027 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:42.251358 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88deca49-756a-45ec-9728-504476d28027 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:42.251779 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88deca49-756a-45ec-9728-504476d28027 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:42.380924 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-88deca49-756a-45ec-9728-504476d28027 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:42.388541 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-88deca49-756a-45ec-9728-504476d28027 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1676 microversion: 2.1 time: 0.150019 Sep 27 16:46:42.390337 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 558/1067] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:42 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:43.413743 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d1727a61-53a5-4f04-a36d-b6aabcc3d810 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:43.414349 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d1727a61-53a5-4f04-a36d-b6aabcc3d810 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:43.421483 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d1727a61-53a5-4f04-a36d-b6aabcc3d810 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:43.421959 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d1727a61-53a5-4f04-a36d-b6aabcc3d810 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:43.422412 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d1727a61-53a5-4f04-a36d-b6aabcc3d810 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:43.423135 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d1727a61-53a5-4f04-a36d-b6aabcc3d810 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:43.423606 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d1727a61-53a5-4f04-a36d-b6aabcc3d810 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:43.424028 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d1727a61-53a5-4f04-a36d-b6aabcc3d810 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:43.559590 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d1727a61-53a5-4f04-a36d-b6aabcc3d810 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:43.568208 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d1727a61-53a5-4f04-a36d-b6aabcc3d810 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1676 microversion: 2.1 time: 0.158466 Sep 27 16:46:43.568783 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 510/1068] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:43 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:46:44.591011 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3ec5576f-eee2-4014-b552-8c66b4a0d51c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:44.591553 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3ec5576f-eee2-4014-b552-8c66b4a0d51c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:44.598028 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ec5576f-eee2-4014-b552-8c66b4a0d51c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:44.598512 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ec5576f-eee2-4014-b552-8c66b4a0d51c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:44.599005 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ec5576f-eee2-4014-b552-8c66b4a0d51c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:44.599673 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ec5576f-eee2-4014-b552-8c66b4a0d51c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:44.600128 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ec5576f-eee2-4014-b552-8c66b4a0d51c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:44.600548 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ec5576f-eee2-4014-b552-8c66b4a0d51c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:44.727300 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3ec5576f-eee2-4014-b552-8c66b4a0d51c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:44.735058 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3ec5576f-eee2-4014-b552-8c66b4a0d51c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1653 microversion: 2.1 time: 0.147897 Sep 27 16:46:44.735614 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 559/1069] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:44 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1653 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:44.757487 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-20503154-17af-4356-9b75-91539b57e745 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:46:44.764593 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-20503154-17af-4356-9b75-91539b57e745 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:44.765208 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-20503154-17af-4356-9b75-91539b57e745 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:44.765640 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-20503154-17af-4356-9b75-91539b57e745 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:44.788301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-20503154-17af-4356-9b75-91539b57e745 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Going to try to start instance {{(pid=127617) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 27 16:46:44.937145 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-20503154-17af-4356-9b75-91539b57e745 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "POST /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e/action" status: 202 len: 0 microversion: 2.1 time: 0.183405 Sep 27 16:46:44.937950 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 511/1070] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Sep 27 16:46:44 2022] POST /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:46:44.946070 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9231367c-8975-40f1-80dd-926259d7245b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:44.947478 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9231367c-8975-40f1-80dd-926259d7245b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:44.953218 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9231367c-8975-40f1-80dd-926259d7245b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:44.953710 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9231367c-8975-40f1-80dd-926259d7245b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:44.954154 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9231367c-8975-40f1-80dd-926259d7245b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:44.954867 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9231367c-8975-40f1-80dd-926259d7245b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:44.955326 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9231367c-8975-40f1-80dd-926259d7245b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:44.955755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9231367c-8975-40f1-80dd-926259d7245b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:45.090952 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9231367c-8975-40f1-80dd-926259d7245b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:45.094955 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9231367c-8975-40f1-80dd-926259d7245b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1662 microversion: 2.1 time: 0.152686 Sep 27 16:46:45.095517 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 560/1071] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:44 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1662 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:46.118515 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ebaec63d-2a8b-4cd5-a34b-65b1719c99d8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:46.119240 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ebaec63d-2a8b-4cd5-a34b-65b1719c99d8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:46.125450 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebaec63d-2a8b-4cd5-a34b-65b1719c99d8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:46.125935 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebaec63d-2a8b-4cd5-a34b-65b1719c99d8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:46.126371 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebaec63d-2a8b-4cd5-a34b-65b1719c99d8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:46.127091 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebaec63d-2a8b-4cd5-a34b-65b1719c99d8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:46.127552 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebaec63d-2a8b-4cd5-a34b-65b1719c99d8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:46.127981 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebaec63d-2a8b-4cd5-a34b-65b1719c99d8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:46.260175 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ebaec63d-2a8b-4cd5-a34b-65b1719c99d8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:46.267917 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ebaec63d-2a8b-4cd5-a34b-65b1719c99d8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1662 microversion: 2.1 time: 0.154171 Sep 27 16:46:46.268554 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 512/1072] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:46 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:46:47.292667 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-48b4c1ce-b05f-417d-b561-8f9adde667ee tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:46:47.293278 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-48b4c1ce-b05f-417d-b561-8f9adde667ee tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:46:47.299341 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48b4c1ce-b05f-417d-b561-8f9adde667ee tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:47.299821 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48b4c1ce-b05f-417d-b561-8f9adde667ee tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:47.300254 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48b4c1ce-b05f-417d-b561-8f9adde667ee tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:47.300937 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48b4c1ce-b05f-417d-b561-8f9adde667ee tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:46:47.301388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48b4c1ce-b05f-417d-b561-8f9adde667ee tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:46:47.301856 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48b4c1ce-b05f-417d-b561-8f9adde667ee tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:46:47.428029 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-48b4c1ce-b05f-417d-b561-8f9adde667ee tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:46:47.436376 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-48b4c1ce-b05f-417d-b561-8f9adde667ee tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1666 microversion: 2.1 time: 0.147156 Sep 27 16:46:47.436938 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 561/1073] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:46:47 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1666 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:19.418132 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9c421091-a5f6-4aa9-a486-696eda213f1d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:19.418132 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9c421091-a5f6-4aa9-a486-696eda213f1d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:19.424870 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 16:47:19.425335 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Tue Sep 27 16:47:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.64) !!! Sep 27 16:47:19.427998 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=16 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:47:19.428848 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=16 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:47:19.429582 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:47:19.430714 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:47:19.431926 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 16:47:19.432119 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Tue Sep 27 16:47:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 (ip 10.222.0.64) !!! Sep 27 16:47:19.439930 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c421091-a5f6-4aa9-a486-696eda213f1d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:19.440576 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c421091-a5f6-4aa9-a486-696eda213f1d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:19.440864 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c421091-a5f6-4aa9-a486-696eda213f1d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:19.441610 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c421091-a5f6-4aa9-a486-696eda213f1d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:19.442358 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c421091-a5f6-4aa9-a486-696eda213f1d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:19.442503 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9c421091-a5f6-4aa9-a486-696eda213f1d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:19.471950 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9c421091-a5f6-4aa9-a486-696eda213f1d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 16:47:19.503970 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-1192deae-7999-4ac0-9172-3a37011c94dd req-992fd6b8-8803-4a3d-ad40-6f99eaaeb990 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be9bfe87-9e1d-4f29-8d03-64ff185cce85", "tag": "de86fe62-fa12-4e70-a861-ea2d30bbe40e"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:47:19.514683 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-1192deae-7999-4ac0-9172-3a37011c94dd req-992fd6b8-8803-4a3d-ad40-6f99eaaeb990 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:19.516089 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-1192deae-7999-4ac0-9172-3a37011c94dd req-992fd6b8-8803-4a3d-ad40-6f99eaaeb990 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:19.516893 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-1192deae-7999-4ac0-9172-3a37011c94dd req-992fd6b8-8803-4a3d-ad40-6f99eaaeb990 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:19.528468 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-1192deae-7999-4ac0-9172-3a37011c94dd req-992fd6b8-8803-4a3d-ad40-6f99eaaeb990 service nova] Creating event network-changed:de86fe62-fa12-4e70-a861-ea2d30bbe40e for instance be9bfe87-9e1d-4f29-8d03-64ff185cce85 on hv-cinder-85506 Sep 27 16:47:19.534549 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-1192deae-7999-4ac0-9172-3a37011c94dd req-992fd6b8-8803-4a3d-ad40-6f99eaaeb990 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115205 Sep 27 16:47:19.535251 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 562/1074] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:47:19.773993 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9c421091-a5f6-4aa9-a486-696eda213f1d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "DELETE /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 204 len: 0 microversion: 2.1 time: 0.361029 Sep 27 16:47:19.775041 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 513/1075] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:47:19 2022] DELETE /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 16:47:19.800848 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a8fb6c40-2638-4093-b48b-93273e17a64f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:19.808168 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a8fb6c40-2638-4093-b48b-93273e17a64f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:19.813559 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8fb6c40-2638-4093-b48b-93273e17a64f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:19.814262 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8fb6c40-2638-4093-b48b-93273e17a64f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:19.815059 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8fb6c40-2638-4093-b48b-93273e17a64f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:19.815682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8fb6c40-2638-4093-b48b-93273e17a64f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:19.816227 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8fb6c40-2638-4093-b48b-93273e17a64f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:19.816821 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8fb6c40-2638-4093-b48b-93273e17a64f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:19.958482 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a8fb6c40-2638-4093-b48b-93273e17a64f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:19.966325 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a8fb6c40-2638-4093-b48b-93273e17a64f tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1575 microversion: 2.1 time: 0.187086 Sep 27 16:47:19.967236 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 563/1076] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:19 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1575 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:20.509406 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f269be2d-ed9d-4bbb-86dd-8a900542819f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:20.511814 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f269be2d-ed9d-4bbb-86dd-8a900542819f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:20.519485 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f269be2d-ed9d-4bbb-86dd-8a900542819f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:20.519976 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f269be2d-ed9d-4bbb-86dd-8a900542819f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:20.520412 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f269be2d-ed9d-4bbb-86dd-8a900542819f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:20.521106 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f269be2d-ed9d-4bbb-86dd-8a900542819f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:20.521564 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f269be2d-ed9d-4bbb-86dd-8a900542819f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:20.521991 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f269be2d-ed9d-4bbb-86dd-8a900542819f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:20.554166 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f269be2d-ed9d-4bbb-86dd-8a900542819f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049074 Sep 27 16:47:20.554720 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 514/1077] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Sep 27 16:47:20 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 16:47:20.619204 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d9e497d4-226b-4b73-a2d9-9720382ef451 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:20.619764 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d9e497d4-226b-4b73-a2d9-9720382ef451 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:20.626325 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9e497d4-226b-4b73-a2d9-9720382ef451 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:20.626827 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9e497d4-226b-4b73-a2d9-9720382ef451 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:20.627263 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9e497d4-226b-4b73-a2d9-9720382ef451 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:20.627951 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9e497d4-226b-4b73-a2d9-9720382ef451 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:20.628400 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9e497d4-226b-4b73-a2d9-9720382ef451 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:20.628823 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d9e497d4-226b-4b73-a2d9-9720382ef451 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:20.654448 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d9e497d4-226b-4b73-a2d9-9720382ef451 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 16:47:20.875332 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d9e497d4-226b-4b73-a2d9-9720382ef451 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "DELETE /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 204 len: 0 microversion: 2.1 time: 0.259120 Sep 27 16:47:20.876045 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 564/1078] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:47:20 2022] DELETE /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 16:47:20.884128 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7a7b09f7-0b25-4d57-ac61-eb0e6126dad1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:20.888987 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7a7b09f7-0b25-4d57-ac61-eb0e6126dad1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:20.890690 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a7b09f7-0b25-4d57-ac61-eb0e6126dad1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:20.891203 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a7b09f7-0b25-4d57-ac61-eb0e6126dad1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:20.891636 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a7b09f7-0b25-4d57-ac61-eb0e6126dad1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:20.892320 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a7b09f7-0b25-4d57-ac61-eb0e6126dad1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:20.892773 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a7b09f7-0b25-4d57-ac61-eb0e6126dad1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:20.893190 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a7b09f7-0b25-4d57-ac61-eb0e6126dad1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:20.992109 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-af4c54e2-e895-41c3-bb47-f6d0128cc4e0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:20.992815 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-af4c54e2-e895-41c3-bb47-f6d0128cc4e0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:20.998897 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-af4c54e2-e895-41c3-bb47-f6d0128cc4e0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:20.999370 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-af4c54e2-e895-41c3-bb47-f6d0128cc4e0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:21.000323 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-af4c54e2-e895-41c3-bb47-f6d0128cc4e0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:21.001020 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-af4c54e2-e895-41c3-bb47-f6d0128cc4e0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:21.001475 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-af4c54e2-e895-41c3-bb47-f6d0128cc4e0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:21.001896 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-af4c54e2-e895-41c3-bb47-f6d0128cc4e0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:21.029468 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7a7b09f7-0b25-4d57-ac61-eb0e6126dad1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:21.039584 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7a7b09f7-0b25-4d57-ac61-eb0e6126dad1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1672 microversion: 2.1 time: 0.158906 Sep 27 16:47:21.042830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 515/1079] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:20 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:21.134694 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-af4c54e2-e895-41c3-bb47-f6d0128cc4e0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:21.142360 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-af4c54e2-e895-41c3-bb47-f6d0128cc4e0 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1575 microversion: 2.1 time: 0.154883 Sep 27 16:47:21.142944 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 565/1080] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:20 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:47:22.063290 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f3ed56b1-7e13-4008-953b-36e468ed8fa9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:22.063877 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f3ed56b1-7e13-4008-953b-36e468ed8fa9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:22.070210 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3ed56b1-7e13-4008-953b-36e468ed8fa9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:22.070689 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3ed56b1-7e13-4008-953b-36e468ed8fa9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:22.071167 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3ed56b1-7e13-4008-953b-36e468ed8fa9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:22.071857 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3ed56b1-7e13-4008-953b-36e468ed8fa9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:22.072305 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3ed56b1-7e13-4008-953b-36e468ed8fa9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:22.072726 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3ed56b1-7e13-4008-953b-36e468ed8fa9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:22.165943 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e2433e24-346f-4b14-9c83-bbe154744c38 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:22.166492 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e2433e24-346f-4b14-9c83-bbe154744c38 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:22.172897 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2433e24-346f-4b14-9c83-bbe154744c38 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:22.176066 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2433e24-346f-4b14-9c83-bbe154744c38 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:22.176066 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2433e24-346f-4b14-9c83-bbe154744c38 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:22.176066 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2433e24-346f-4b14-9c83-bbe154744c38 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:22.176066 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2433e24-346f-4b14-9c83-bbe154744c38 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:22.176468 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2433e24-346f-4b14-9c83-bbe154744c38 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:22.209322 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f3ed56b1-7e13-4008-953b-36e468ed8fa9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:22.217373 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f3ed56b1-7e13-4008-953b-36e468ed8fa9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1672 microversion: 2.1 time: 0.158576 Sep 27 16:47:22.217954 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 516/1081] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:22 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:22.307972 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e2433e24-346f-4b14-9c83-bbe154744c38 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:22.316528 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e2433e24-346f-4b14-9c83-bbe154744c38 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1575 microversion: 2.1 time: 0.154579 Sep 27 16:47:22.317100 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 566/1082] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:22 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:23.241405 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0b65fa64-a611-446f-baf3-c888477aed24 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:23.242056 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0b65fa64-a611-446f-baf3-c888477aed24 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:23.248933 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b65fa64-a611-446f-baf3-c888477aed24 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:23.249435 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b65fa64-a611-446f-baf3-c888477aed24 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:23.250461 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b65fa64-a611-446f-baf3-c888477aed24 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:23.251184 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b65fa64-a611-446f-baf3-c888477aed24 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:23.251648 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b65fa64-a611-446f-baf3-c888477aed24 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:23.252076 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b65fa64-a611-446f-baf3-c888477aed24 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:23.340837 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bda72453-f296-4160-b67f-85beb4031907 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:23.341459 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bda72453-f296-4160-b67f-85beb4031907 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:23.351053 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bda72453-f296-4160-b67f-85beb4031907 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:23.351053 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bda72453-f296-4160-b67f-85beb4031907 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:23.351474 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bda72453-f296-4160-b67f-85beb4031907 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:23.352460 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bda72453-f296-4160-b67f-85beb4031907 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:23.353118 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bda72453-f296-4160-b67f-85beb4031907 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:23.353540 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bda72453-f296-4160-b67f-85beb4031907 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:23.570891 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0b65fa64-a611-446f-baf3-c888477aed24 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:23.579993 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0b65fa64-a611-446f-baf3-c888477aed24 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1672 microversion: 2.1 time: 0.342654 Sep 27 16:47:23.590146 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 517/1083] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:23 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1672 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:23.619059 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bda72453-f296-4160-b67f-85beb4031907 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:23.627387 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bda72453-f296-4160-b67f-85beb4031907 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1575 microversion: 2.1 time: 0.290348 Sep 27 16:47:23.628321 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 567/1084] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:23 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1575 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:24.051459 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-ea5b1fbb-7fed-4226-9861-0c372bedc1a9 req-38d81387-aab5-4990-8bbd-38607e76beaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be9bfe87-9e1d-4f29-8d03-64ff185cce85", "name": "network-vif-deleted", "tag": "de86fe62-fa12-4e70-a861-ea2d30bbe40e"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:47:24.060735 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-ea5b1fbb-7fed-4226-9861-0c372bedc1a9 req-38d81387-aab5-4990-8bbd-38607e76beaa service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:24.061454 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-ea5b1fbb-7fed-4226-9861-0c372bedc1a9 req-38d81387-aab5-4990-8bbd-38607e76beaa service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:24.062525 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-ea5b1fbb-7fed-4226-9861-0c372bedc1a9 req-38d81387-aab5-4990-8bbd-38607e76beaa service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:24.073400 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-ea5b1fbb-7fed-4226-9861-0c372bedc1a9 req-38d81387-aab5-4990-8bbd-38607e76beaa service nova] Creating event network-vif-deleted:de86fe62-fa12-4e70-a861-ea2d30bbe40e for instance be9bfe87-9e1d-4f29-8d03-64ff185cce85 on hv-cinder-85506 Sep 27 16:47:24.078863 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-ea5b1fbb-7fed-4226-9861-0c372bedc1a9 req-38d81387-aab5-4990-8bbd-38607e76beaa service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096832 Sep 27 16:47:24.079619 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 518/1085] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:47:24.490225 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-c592928a-bcaf-45a5-ad65-71a6fc6f8092 req-377322fb-67f9-4593-8ed1-ee170e789601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23412d14-1e6d-4792-b23b-591d19c2bd7e", "name": "network-vif-deleted", "tag": "82f04415-4ca4-4d99-88bc-515bfb4984d7"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:47:24.500433 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-c592928a-bcaf-45a5-ad65-71a6fc6f8092 req-377322fb-67f9-4593-8ed1-ee170e789601 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:24.501270 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-c592928a-bcaf-45a5-ad65-71a6fc6f8092 req-377322fb-67f9-4593-8ed1-ee170e789601 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:24.501798 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-c592928a-bcaf-45a5-ad65-71a6fc6f8092 req-377322fb-67f9-4593-8ed1-ee170e789601 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:24.514178 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-c592928a-bcaf-45a5-ad65-71a6fc6f8092 req-377322fb-67f9-4593-8ed1-ee170e789601 service nova] Creating event network-vif-deleted:82f04415-4ca4-4d99-88bc-515bfb4984d7 for instance 23412d14-1e6d-4792-b23b-591d19c2bd7e on hv-cinder-85506 Sep 27 16:47:24.520383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-c592928a-bcaf-45a5-ad65-71a6fc6f8092 req-377322fb-67f9-4593-8ed1-ee170e789601 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041058 Sep 27 16:47:24.524184 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 568/1086] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:47:24.606106 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-75ac06f6-4a07-4030-be84-542cc7b386ef tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:24.607989 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-75ac06f6-4a07-4030-be84-542cc7b386ef tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:24.615936 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-75ac06f6-4a07-4030-be84-542cc7b386ef tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:24.616550 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-75ac06f6-4a07-4030-be84-542cc7b386ef tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:24.616994 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-75ac06f6-4a07-4030-be84-542cc7b386ef tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:24.617715 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-75ac06f6-4a07-4030-be84-542cc7b386ef tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:24.618344 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-75ac06f6-4a07-4030-be84-542cc7b386ef tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:24.618804 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-75ac06f6-4a07-4030-be84-542cc7b386ef tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:24.652550 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-352db0a7-3d04-463b-aecb-4f82af9f6724 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:24.653271 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-352db0a7-3d04-463b-aecb-4f82af9f6724 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:24.668522 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-352db0a7-3d04-463b-aecb-4f82af9f6724 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:24.668750 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-352db0a7-3d04-463b-aecb-4f82af9f6724 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:24.668991 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-352db0a7-3d04-463b-aecb-4f82af9f6724 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:24.669778 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-352db0a7-3d04-463b-aecb-4f82af9f6724 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:24.682729 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-352db0a7-3d04-463b-aecb-4f82af9f6724 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:24.683826 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-352db0a7-3d04-463b-aecb-4f82af9f6724 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:24.714338 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-75ac06f6-4a07-4030-be84-542cc7b386ef tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:24.725570 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-75ac06f6-4a07-4030-be84-542cc7b386ef tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1320 microversion: 2.1 time: 0.124565 Sep 27 16:47:24.726346 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 519/1087] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:24 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1320 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:47:24.743721 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-352db0a7-3d04-463b-aecb-4f82af9f6724 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:24.743721 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-352db0a7-3d04-463b-aecb-4f82af9f6724 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:24.743721 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-352db0a7-3d04-463b-aecb-4f82af9f6724 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:24.743721 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-352db0a7-3d04-463b-aecb-4f82af9f6724 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lazy-loading 'fault' on Instance uuid be9bfe87-9e1d-4f29-8d03-64ff185cce85 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:47:24.792260 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-352db0a7-3d04-463b-aecb-4f82af9f6724 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:24.801025 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-352db0a7-3d04-463b-aecb-4f82af9f6724 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 200 len: 1229 microversion: 2.1 time: 0.153044 Sep 27 16:47:24.805424 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 569/1088] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:24 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 1229 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:25.748534 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6a8d6203-5e93-4a9d-84cb-40a7e111a59b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:25.749111 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6a8d6203-5e93-4a9d-84cb-40a7e111a59b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:25.756493 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a8d6203-5e93-4a9d-84cb-40a7e111a59b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:25.756985 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a8d6203-5e93-4a9d-84cb-40a7e111a59b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:25.757424 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a8d6203-5e93-4a9d-84cb-40a7e111a59b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:25.758125 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a8d6203-5e93-4a9d-84cb-40a7e111a59b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:25.758584 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a8d6203-5e93-4a9d-84cb-40a7e111a59b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:25.759394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a8d6203-5e93-4a9d-84cb-40a7e111a59b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:25.790195 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a8d6203-5e93-4a9d-84cb-40a7e111a59b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:25.790675 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a8d6203-5e93-4a9d-84cb-40a7e111a59b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:25.791149 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6a8d6203-5e93-4a9d-84cb-40a7e111a59b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:25.793307 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-6a8d6203-5e93-4a9d-84cb-40a7e111a59b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lazy-loading 'fault' on Instance uuid 23412d14-1e6d-4792-b23b-591d19c2bd7e {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:47:25.825822 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-963e7967-add7-49f5-85f8-601d11244aef tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:25.826432 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-963e7967-add7-49f5-85f8-601d11244aef tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: be9bfe87-9e1d-4f29-8d03-64ff185cce85] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:25.833049 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-963e7967-add7-49f5-85f8-601d11244aef tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:25.833563 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-963e7967-add7-49f5-85f8-601d11244aef tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:25.834092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-963e7967-add7-49f5-85f8-601d11244aef tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:25.834967 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-963e7967-add7-49f5-85f8-601d11244aef tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:25.835422 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-963e7967-add7-49f5-85f8-601d11244aef tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:25.835845 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-963e7967-add7-49f5-85f8-601d11244aef tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:25.838967 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6a8d6203-5e93-4a9d-84cb-40a7e111a59b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:25.847319 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6a8d6203-5e93-4a9d-84cb-40a7e111a59b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 200 len: 1325 microversion: 2.1 time: 0.102710 Sep 27 16:47:25.847964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 520/1089] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:25 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 1325 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:25.851364 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-963e7967-add7-49f5-85f8-601d11244aef tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] HTTP exception thrown: Instance be9bfe87-9e1d-4f29-8d03-64ff185cce85 could not be found. Sep 27 16:47:25.852102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-963e7967-add7-49f5-85f8-601d11244aef tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Request method failure captured: Sep 27 16:47:25.852102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 HTTP/1.1 Sep 27 16:47:25.852102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:47:25.852102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:47:25.852102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:47:25.852102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:47:25.852102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:47:25.852102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:47:25.852102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:47:25.852102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:47:25.852102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMycmHtLFvrjDMir7PsAl0jrokT3pa5jWD2AqQrwOiXUSlp_VBcvOvskgl7hrGZA-R6N8tY93GKubrDEbGHZBxN-0A8f0iTnGL1Me323dLs24OolKvT3wb_agnoXINlz6fmbhBYmwIDMLWanClMBO1rnYG_y7132m0PKHDP3kJPGf9_I Sep 27 16:47:25.852102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:47:25.852102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:47:25.852102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:47:25.852102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:47:25.852102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:47:25.852102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:47:25.852102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 1e0f894b53284e788cdb4864acd917be Sep 27 16:47:25.852102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-TestVolumeBootPattern-410545175 Sep 27 16:47:25.852102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:47:25.852102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:47:25.853847 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e0f894b53284e788cdb4864acd917be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1e0f894b53284e788cdb4864acd917be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1e0f894b53284e788cdb4864acd917be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e0f894b53284e788cdb4864acd917be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:47:25.853847 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-TestVolumeBootPattern-410545175 Sep 27 16:47:25.853847 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 1e0f894b53284e788cdb4864acd917be Sep 27 16:47:25.853847 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-TestVolumeBootPattern-410545175 Sep 27 16:47:25.853847 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-TestVolumeBootPattern-410545175-project Sep 27 16:47:25.853847 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:47:25.853847 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:47:25.853847 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: 421aaa238a3c495096dfc55aba76267c Sep 27 16:47:25.853847 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-TestVolumeBootPattern-410545175-project Sep 27 16:47:25.853847 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:47:25.853847 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Instance be9bfe87-9e1d-4f29-8d03-64ff185cce85 could not be found. Sep 27 16:47:25.853847 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': 'be9bfe87-9e1d-4f29-8d03-64ff185cce85'} Sep 27 16:47:25.854956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:47:25.854956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:47:25.854956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:47:25.854956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:47:25.854956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:47:25.854956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:47:25.854956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:47:25.854956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:47:25.854956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:47:25.854956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:47:25.854956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be9bfe87-9e1d-4f29-8d03-64ff185cce85 could not be found. Sep 27 16:47:25.854956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:47:25.854956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:47:25.854956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:47:25.854956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:47:25.854956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:47:25.854956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:47:25.854956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:47:25.854956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:47:25.854956 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:47:25.856633 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:47:25.856633 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:47:25.856633 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:47:25.856633 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:47:25.856633 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:47:25.856633 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:47:25.856633 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:47:25.856633 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be9bfe87-9e1d-4f29-8d03-64ff185cce85 could not be found. Sep 27 16:47:25.856633 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:47:25.856633 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:47:25.856633 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:47:25.856633 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:47:25.856633 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:47:25.856633 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:47:25.856633 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:47:25.856633 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:47:25.856633 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be9bfe87-9e1d-4f29-8d03-64ff185cce85 could not be found. Sep 27 16:47:25.856633 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:47:25.858127 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-963e7967-add7-49f5-85f8-601d11244aef tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Returning 404 to user: Instance be9bfe87-9e1d-4f29-8d03-64ff185cce85 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:47:25.858127 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-963e7967-add7-49f5-85f8-601d11244aef tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85" status: 404 len: 111 microversion: 2.1 time: 0.031762 Sep 27 16:47:25.858127 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 570/1090] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:25 2022] GET /compute/v2.1/servers/be9bfe87-9e1d-4f29-8d03-64ff185cce85 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 16:47:26.875507 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2c7b0d4e-25c6-4828-86a2-9c7920f317ce tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:26.876113 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2c7b0d4e-25c6-4828-86a2-9c7920f317ce tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:26.882680 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2c7b0d4e-25c6-4828-86a2-9c7920f317ce tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:26.885046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2c7b0d4e-25c6-4828-86a2-9c7920f317ce tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:26.885046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2c7b0d4e-25c6-4828-86a2-9c7920f317ce tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:26.885046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2c7b0d4e-25c6-4828-86a2-9c7920f317ce tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:26.885046 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2c7b0d4e-25c6-4828-86a2-9c7920f317ce tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:26.885433 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2c7b0d4e-25c6-4828-86a2-9c7920f317ce tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:26.899028 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-2c7b0d4e-25c6-4828-86a2-9c7920f317ce tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] HTTP exception thrown: Instance 23412d14-1e6d-4792-b23b-591d19c2bd7e could not be found. Sep 27 16:47:26.900668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2c7b0d4e-25c6-4828-86a2-9c7920f317ce tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Request method failure captured: Sep 27 16:47:26.900668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e HTTP/1.1 Sep 27 16:47:26.900668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:47:26.900668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:47:26.900668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:47:26.900668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 27 16:47:26.900668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:47:26.900668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:47:26.900668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:47:26.900668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:47:26.900668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMyhe3ijCW-0eb711E_CbiCMZmKgskfwuv5H8R9ZZlytvg5HiDT0-muk6wyCzh_hXXzXcwtrtj6eqY-144ZgFsT67TZ3UixmaDeR5lsVOPFZPlKdeQjzjlgEU4d_JYgjDQQAuSWzFgNJui_6n0XWVZgSQavCPJuu4lRrWncLx09QeYpw Sep 27 16:47:26.900668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:47:26.900668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:47:26.900668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:47:26.900668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:47:26.900668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:47:26.900668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:47:26.900668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: 0a89110c26344f608dae59f5616575f3 Sep 27 16:47:26.900668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeTestJSON-1890074404 Sep 27 16:47:26.900668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:47:26.900668 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:47:26.902322 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a89110c26344f608dae59f5616575f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0a89110c26344f608dae59f5616575f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0a89110c26344f608dae59f5616575f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a89110c26344f608dae59f5616575f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:47:26.902322 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeTestJSON-1890074404 Sep 27 16:47:26.902322 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 0a89110c26344f608dae59f5616575f3 Sep 27 16:47:26.902322 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1890074404 Sep 27 16:47:26.902322 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeTestJSON-1890074404-project Sep 27 16:47:26.902322 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:47:26.902322 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:47:26.902322 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: 09cb0d1d7888436dae18a45598a8c82a Sep 27 16:47:26.902322 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeTestJSON-1890074404-project Sep 27 16:47:26.902322 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: > Sep 27 16:47:26.902322 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Instance 23412d14-1e6d-4792-b23b-591d19c2bd7e could not be found. Sep 27 16:47:26.902322 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'id': '23412d14-1e6d-4792-b23b-591d19c2bd7e'} Sep 27 16:47:26.903350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:47:26.903350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:47:26.903350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:47:26.903350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:47:26.903350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:47:26.903350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:47:26.903350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:47:26.903350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:47:26.903350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:47:26.903350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:47:26.903350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23412d14-1e6d-4792-b23b-591d19c2bd7e could not be found. Sep 27 16:47:26.903350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:47:26.903350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:47:26.903350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:47:26.903350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:47:26.903350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:47:26.903350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:47:26.903350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:47:26.903350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:47:26.903350 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:47:26.904938 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:47:26.904938 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:47:26.904938 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:47:26.904938 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:47:26.904938 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:47:26.904938 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:47:26.904938 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:47:26.904938 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23412d14-1e6d-4792-b23b-591d19c2bd7e could not be found. Sep 27 16:47:26.904938 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:47:26.904938 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:47:26.904938 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:47:26.904938 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:47:26.904938 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:47:26.904938 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:47:26.904938 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:47:26.904938 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:47:26.904938 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23412d14-1e6d-4792-b23b-591d19c2bd7e could not be found. Sep 27 16:47:26.904938 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:47:26.906583 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2c7b0d4e-25c6-4828-86a2-9c7920f317ce tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Returning 404 to user: Instance 23412d14-1e6d-4792-b23b-591d19c2bd7e could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:47:26.906583 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2c7b0d4e-25c6-4828-86a2-9c7920f317ce tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 404 len: 111 microversion: 2.1 time: 0.031289 Sep 27 16:47:26.906583 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 521/1091] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:26 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:47:26.911569 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-be74952e-55c8-4b05-bc9b-84eaac247e29 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '.version_select at 0x7fa4090c33a0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:27.013014 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-be74952e-55c8-4b05-bc9b-84eaac247e29 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-8737856" status: 202 len: 0 microversion: 2.1 time: 0.105218 Sep 27 16:47:27.013593 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 571/1092] 10.222.0.64 () {58 vars in 1212 bytes} [Tue Sep 27 16:47:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-8737856 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:47:27.779130 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-369df237-84d8-49c0-978b-7bfe7151e4f5 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Action: 'create', calling method: .version_select at 0x7fa4055e7280>, body: {"keypair": {"name": "tempest-keypair-653063763", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVB4nQnxG8SYGFuIsj49Th1bGHS4FI29T6CfERHtYt6qm9M0NQu1202UVR0kULsvjqoSkvOXT7coEdcsiNb85Vq7vE46qeX2gE/TJQUJ1NVllHk7eNah0Hq/FUjAKm0Mg=="}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:47:27.795372 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-369df237-84d8-49c0-978b-7bfe7151e4f5 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Getting quotas for project 0a89110c26344f608dae59f5616575f3. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:47:27.799431 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-369df237-84d8-49c0-978b-7bfe7151e4f5 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Getting quotas for user 09cb0d1d7888436dae18a45598a8c82a and project 0a89110c26344f608dae59f5616575f3. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:47:27.894564 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-369df237-84d8-49c0-978b-7bfe7151e4f5 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.119534 Sep 27 16:47:27.895284 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 522/1093] 10.222.0.64 () {60 vars in 1159 bytes} [Tue Sep 27 16:47:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:47:29.346342 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-aa3318a2-9c16-479e-ad09-811b55aa37f5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:29.346829 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-b970f42b-a403-49eb-af4f-2cf616f5db0b req-5f0f3d68-556e-4cfe-831c-8933ffbefe92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50687ace-d869-4712-9cf7-0d16c7244ac7", "tag": "bfce7c0e-1dc8-42b2-b518-7b30f07592fc"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:47:29.347222 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-aa3318a2-9c16-479e-ad09-811b55aa37f5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:29.355794 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa3318a2-9c16-479e-ad09-811b55aa37f5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:29.359839 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa3318a2-9c16-479e-ad09-811b55aa37f5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:29.359839 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa3318a2-9c16-479e-ad09-811b55aa37f5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:29.359839 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa3318a2-9c16-479e-ad09-811b55aa37f5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:29.359839 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa3318a2-9c16-479e-ad09-811b55aa37f5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:29.360253 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-b970f42b-a403-49eb-af4f-2cf616f5db0b req-5f0f3d68-556e-4cfe-831c-8933ffbefe92 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:29.360366 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa3318a2-9c16-479e-ad09-811b55aa37f5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:29.360461 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-b970f42b-a403-49eb-af4f-2cf616f5db0b req-5f0f3d68-556e-4cfe-831c-8933ffbefe92 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:29.360461 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-b970f42b-a403-49eb-af4f-2cf616f5db0b req-5f0f3d68-556e-4cfe-831c-8933ffbefe92 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:29.372384 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-b970f42b-a403-49eb-af4f-2cf616f5db0b req-5f0f3d68-556e-4cfe-831c-8933ffbefe92 service nova] Creating event network-changed:bfce7c0e-1dc8-42b2-b518-7b30f07592fc for instance 50687ace-d869-4712-9cf7-0d16c7244ac7 on hv-cinder-85506 Sep 27 16:47:29.378188 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-b970f42b-a403-49eb-af4f-2cf616f5db0b req-5f0f3d68-556e-4cfe-831c-8933ffbefe92 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039274 Sep 27 16:47:29.379551 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 523/1094] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:47:29.385662 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-aa3318a2-9c16-479e-ad09-811b55aa37f5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 16:47:29.745928 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-aa3318a2-9c16-479e-ad09-811b55aa37f5 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "DELETE /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 204 len: 0 microversion: 2.1 time: 0.409372 Sep 27 16:47:29.746716 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 572/1095] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:47:29 2022] DELETE /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 16:47:29.757311 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-27845421-f48c-40f4-8f82-90fc8f0fdc43 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:29.757583 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-27845421-f48c-40f4-8f82-90fc8f0fdc43 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:29.772598 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27845421-f48c-40f4-8f82-90fc8f0fdc43 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:29.775736 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27845421-f48c-40f4-8f82-90fc8f0fdc43 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:29.778241 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27845421-f48c-40f4-8f82-90fc8f0fdc43 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:29.779273 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27845421-f48c-40f4-8f82-90fc8f0fdc43 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:29.783205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27845421-f48c-40f4-8f82-90fc8f0fdc43 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:29.784762 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-27845421-f48c-40f4-8f82-90fc8f0fdc43 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:30.024443 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-27845421-f48c-40f4-8f82-90fc8f0fdc43 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:30.032694 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-27845421-f48c-40f4-8f82-90fc8f0fdc43 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1576 microversion: 2.1 time: 0.280400 Sep 27 16:47:30.033311 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 524/1096] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:29 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1576 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:30.352780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d686045b-ada0-48c7-bdb9-69b51ab3af94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1451477666", "imageRef": "6908a343-46fa-4801-bfb5-7ad92ac26956", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6f6f055-03fc-4efc-8706-3ef9e91b6fee"}], "security_groups": [{"name": "tempest-securitygroup--184962717"}], "key_name": "tempest-keypair-653063763", "user_data": "}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:47:30.471791 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-d686045b-ada0-48c7-bdb9-69b51ab3af94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] validate_networks() for [('c6f6f055-03fc-4efc-8706-3ef9e91b6fee', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 16:47:30.904573 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-d686045b-ada0-48c7-bdb9-69b51ab3af94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 16:47:30.905002 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-d686045b-ada0-48c7-bdb9-69b51ab3af94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 16:47:30.906621 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-d686045b-ada0-48c7-bdb9-69b51ab3af94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 16:47:30.907092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-d686045b-ada0-48c7-bdb9-69b51ab3af94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 16:47:30.907524 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-d686045b-ada0-48c7-bdb9-69b51ab3af94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 16:47:30.916245 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d686045b-ada0-48c7-bdb9-69b51ab3af94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:30.916739 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d686045b-ada0-48c7-bdb9-69b51ab3af94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:30.917171 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d686045b-ada0-48c7-bdb9-69b51ab3af94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:30.917902 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d686045b-ada0-48c7-bdb9-69b51ab3af94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:30.918363 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d686045b-ada0-48c7-bdb9-69b51ab3af94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:30.918812 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d686045b-ada0-48c7-bdb9-69b51ab3af94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:30.935836 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-d686045b-ada0-48c7-bdb9-69b51ab3af94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Getting quotas for project 0a89110c26344f608dae59f5616575f3. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 16:47:30.940448 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-d686045b-ada0-48c7-bdb9-69b51ab3af94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Getting quotas for user 09cb0d1d7888436dae18a45598a8c82a and project 0a89110c26344f608dae59f5616575f3. Resources: {'instances', 'ram', 'cores'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 16:47:30.951538 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d686045b-ada0-48c7-bdb9-69b51ab3af94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 16:47:30.955086 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d686045b-ada0-48c7-bdb9-69b51ab3af94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6908a343-46fa-4801-bfb5-7ad92ac26956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 16:47:31.060024 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4a4e8063-cd90-4c3f-98e2-86b53b5f7434 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:31.061090 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4a4e8063-cd90-4c3f-98e2-86b53b5f7434 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:31.069720 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4a4e8063-cd90-4c3f-98e2-86b53b5f7434 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:31.074140 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4a4e8063-cd90-4c3f-98e2-86b53b5f7434 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:31.074140 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4a4e8063-cd90-4c3f-98e2-86b53b5f7434 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:31.074140 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4a4e8063-cd90-4c3f-98e2-86b53b5f7434 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:31.074140 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4a4e8063-cd90-4c3f-98e2-86b53b5f7434 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:31.074585 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4a4e8063-cd90-4c3f-98e2-86b53b5f7434 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:31.081706 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d686045b-ada0-48c7-bdb9-69b51ab3af94 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.733575 Sep 27 16:47:31.082570 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 573/1097] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Sep 27 16:47:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 16:47:31.096547 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8ed4403c-66cd-4bb4-b902-79bc37c48b75 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:31.096547 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8ed4403c-66cd-4bb4-b902-79bc37c48b75 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:31.186227 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8ed4403c-66cd-4bb4-b902-79bc37c48b75 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:31.196608 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8ed4403c-66cd-4bb4-b902-79bc37c48b75 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813" status: 200 len: 1237 microversion: 2.1 time: 0.106760 Sep 27 16:47:31.199214 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 574/1098] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:31 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 => generated 1237 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:47:31.270140 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4a4e8063-cd90-4c3f-98e2-86b53b5f7434 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:31.280320 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4a4e8063-cd90-4c3f-98e2-86b53b5f7434 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1576 microversion: 2.1 time: 0.226262 Sep 27 16:47:31.281028 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 525/1099] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:31 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1576 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:32.106317 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-da6320b6-f68b-41ba-adbe-7d6319c8ea84 req-d9512af1-a428-4911-bf47-499bd500edb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50687ace-d869-4712-9cf7-0d16c7244ac7", "name": "network-vif-deleted", "tag": "bfce7c0e-1dc8-42b2-b518-7b30f07592fc"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:47:32.116439 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-da6320b6-f68b-41ba-adbe-7d6319c8ea84 req-d9512af1-a428-4911-bf47-499bd500edb3 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:32.116943 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-da6320b6-f68b-41ba-adbe-7d6319c8ea84 req-d9512af1-a428-4911-bf47-499bd500edb3 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:32.117374 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-da6320b6-f68b-41ba-adbe-7d6319c8ea84 req-d9512af1-a428-4911-bf47-499bd500edb3 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:32.128023 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-da6320b6-f68b-41ba-adbe-7d6319c8ea84 req-d9512af1-a428-4911-bf47-499bd500edb3 service nova] Creating event network-vif-deleted:bfce7c0e-1dc8-42b2-b518-7b30f07592fc for instance 50687ace-d869-4712-9cf7-0d16c7244ac7 on hv-cinder-85506 Sep 27 16:47:32.137478 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-da6320b6-f68b-41ba-adbe-7d6319c8ea84 req-d9512af1-a428-4911-bf47-499bd500edb3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030091 Sep 27 16:47:32.137478 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 575/1100] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:47:32.221288 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1ba23e01-98a1-4822-86ff-e477615dcc30 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:32.221873 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1ba23e01-98a1-4822-86ff-e477615dcc30 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:32.228824 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1ba23e01-98a1-4822-86ff-e477615dcc30 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:32.229316 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1ba23e01-98a1-4822-86ff-e477615dcc30 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:32.229870 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1ba23e01-98a1-4822-86ff-e477615dcc30 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:32.230600 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1ba23e01-98a1-4822-86ff-e477615dcc30 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:32.231083 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1ba23e01-98a1-4822-86ff-e477615dcc30 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:32.231509 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1ba23e01-98a1-4822-86ff-e477615dcc30 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:32.300070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1ba23e01-98a1-4822-86ff-e477615dcc30 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:32.303984 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2e233021-db25-4533-a505-fc36a0dc1c2c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:32.304684 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2e233021-db25-4533-a505-fc36a0dc1c2c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:32.308093 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1ba23e01-98a1-4822-86ff-e477615dcc30 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813" status: 200 len: 1241 microversion: 2.1 time: 0.091412 Sep 27 16:47:32.308952 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 526/1101] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:32 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:32.311235 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2e233021-db25-4533-a505-fc36a0dc1c2c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:32.311856 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2e233021-db25-4533-a505-fc36a0dc1c2c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:32.312422 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2e233021-db25-4533-a505-fc36a0dc1c2c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:32.313307 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2e233021-db25-4533-a505-fc36a0dc1c2c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:32.313761 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2e233021-db25-4533-a505-fc36a0dc1c2c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:32.314252 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2e233021-db25-4533-a505-fc36a0dc1c2c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:32.380214 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2e233021-db25-4533-a505-fc36a0dc1c2c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:32.388857 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2e233021-db25-4533-a505-fc36a0dc1c2c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1225 microversion: 2.1 time: 0.089133 Sep 27 16:47:32.394311 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 576/1102] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:32 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:47:33.333085 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c9d18ba2-1376-40a3-8456-75ce21a82940 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:33.333647 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c9d18ba2-1376-40a3-8456-75ce21a82940 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:33.340069 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9d18ba2-1376-40a3-8456-75ce21a82940 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:33.340547 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9d18ba2-1376-40a3-8456-75ce21a82940 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:33.340999 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9d18ba2-1376-40a3-8456-75ce21a82940 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:33.341688 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9d18ba2-1376-40a3-8456-75ce21a82940 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:33.342195 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9d18ba2-1376-40a3-8456-75ce21a82940 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:33.342618 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9d18ba2-1376-40a3-8456-75ce21a82940 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:33.404681 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c9d18ba2-1376-40a3-8456-75ce21a82940 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:33.412590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e6736c59-f5dd-4126-ba21-3fb0965bdf8a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:33.413195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e6736c59-f5dd-4126-ba21-3fb0965bdf8a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:33.414161 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c9d18ba2-1376-40a3-8456-75ce21a82940 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813" status: 200 len: 1289 microversion: 2.1 time: 0.084996 Sep 27 16:47:33.414739 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 527/1103] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:33 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:33.419691 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6736c59-f5dd-4126-ba21-3fb0965bdf8a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:33.420378 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6736c59-f5dd-4126-ba21-3fb0965bdf8a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:33.420822 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6736c59-f5dd-4126-ba21-3fb0965bdf8a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:33.421521 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6736c59-f5dd-4126-ba21-3fb0965bdf8a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:33.422283 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6736c59-f5dd-4126-ba21-3fb0965bdf8a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:33.422722 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6736c59-f5dd-4126-ba21-3fb0965bdf8a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:33.454702 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6736c59-f5dd-4126-ba21-3fb0965bdf8a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:33.455209 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6736c59-f5dd-4126-ba21-3fb0965bdf8a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:33.455641 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6736c59-f5dd-4126-ba21-3fb0965bdf8a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:33.456089 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-e6736c59-f5dd-4126-ba21-3fb0965bdf8a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lazy-loading 'fault' on Instance uuid 50687ace-d869-4712-9cf7-0d16c7244ac7 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:47:33.496202 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e6736c59-f5dd-4126-ba21-3fb0965bdf8a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '421aaa238a3c495096dfc55aba76267c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f894b53284e788cdb4864acd917be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:33.504496 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e6736c59-f5dd-4126-ba21-3fb0965bdf8a tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 200 len: 1230 microversion: 2.1 time: 0.095721 Sep 27 16:47:33.505062 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 577/1104] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:33 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:47:34.437179 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c4bd5f72-ecca-408d-9a28-2d912bc03c68 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:34.437748 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c4bd5f72-ecca-408d-9a28-2d912bc03c68 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:34.444701 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4bd5f72-ecca-408d-9a28-2d912bc03c68 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:34.450885 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4bd5f72-ecca-408d-9a28-2d912bc03c68 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:34.450885 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4bd5f72-ecca-408d-9a28-2d912bc03c68 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:34.450885 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4bd5f72-ecca-408d-9a28-2d912bc03c68 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:34.450885 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4bd5f72-ecca-408d-9a28-2d912bc03c68 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:34.451298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c4bd5f72-ecca-408d-9a28-2d912bc03c68 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:34.514137 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c4bd5f72-ecca-408d-9a28-2d912bc03c68 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:34.522993 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c4bd5f72-ecca-408d-9a28-2d912bc03c68 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813" status: 200 len: 1295 microversion: 2.1 time: 0.089860 Sep 27 16:47:34.523573 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 528/1105] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:34 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 => generated 1295 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:47:34.535189 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d6279c52-57d2-4abb-8d75-2fd2d0c08873 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:34.535807 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d6279c52-57d2-4abb-8d75-2fd2d0c08873 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 50687ace-d869-4712-9cf7-0d16c7244ac7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:34.542052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6279c52-57d2-4abb-8d75-2fd2d0c08873 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:34.542560 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6279c52-57d2-4abb-8d75-2fd2d0c08873 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:34.543180 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6279c52-57d2-4abb-8d75-2fd2d0c08873 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:34.543946 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6279c52-57d2-4abb-8d75-2fd2d0c08873 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:34.544412 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6279c52-57d2-4abb-8d75-2fd2d0c08873 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:34.544842 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d6279c52-57d2-4abb-8d75-2fd2d0c08873 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:34.559102 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-d6279c52-57d2-4abb-8d75-2fd2d0c08873 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] HTTP exception thrown: Instance 50687ace-d869-4712-9cf7-0d16c7244ac7 could not be found. Sep 27 16:47:34.560780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d6279c52-57d2-4abb-8d75-2fd2d0c08873 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Request method failure captured: Sep 27 16:47:34.560780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 HTTP/1.1 Sep 27 16:47:34.560780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:47:34.560780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:47:34.560780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:47:34.560780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:47:34.560780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:47:34.560780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:47:34.560780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:47:34.560780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:47:34.560780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMycmHtLFvrjDMir7PsAl0jrokT3pa5jWD2AqQrwOiXUSlp_VBcvOvskgl7hrGZA-R6N8tY93GKubrDEbGHZBxN-0A8f0iTnGL1Me323dLs24OolKvT3wb_agnoXINlz6fmbhBYmwIDMLWanClMBO1rnYG_y7132m0PKHDP3kJPGf9_I Sep 27 16:47:34.560780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:47:34.560780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:47:34.560780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:47:34.560780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:47:34.560780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:47:34.560780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:47:34.560780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 1e0f894b53284e788cdb4864acd917be Sep 27 16:47:34.560780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-TestVolumeBootPattern-410545175 Sep 27 16:47:34.560780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:47:34.560780 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:47:34.562627 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e0f894b53284e788cdb4864acd917be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1e0f894b53284e788cdb4864acd917be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1e0f894b53284e788cdb4864acd917be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e0f894b53284e788cdb4864acd917be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:47:34.562627 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-TestVolumeBootPattern-410545175 Sep 27 16:47:34.562627 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 1e0f894b53284e788cdb4864acd917be Sep 27 16:47:34.562627 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-TestVolumeBootPattern-410545175 Sep 27 16:47:34.562627 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-TestVolumeBootPattern-410545175-project Sep 27 16:47:34.562627 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:47:34.562627 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:47:34.562627 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: 421aaa238a3c495096dfc55aba76267c Sep 27 16:47:34.562627 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-TestVolumeBootPattern-410545175-project Sep 27 16:47:34.562627 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:47:34.562627 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Instance 50687ace-d869-4712-9cf7-0d16c7244ac7 could not be found. Sep 27 16:47:34.562627 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': '50687ace-d869-4712-9cf7-0d16c7244ac7'} Sep 27 16:47:34.563610 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:47:34.563610 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:47:34.563610 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:47:34.563610 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:47:34.563610 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:47:34.563610 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:47:34.563610 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:47:34.563610 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:47:34.563610 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:47:34.563610 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:47:34.563610 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50687ace-d869-4712-9cf7-0d16c7244ac7 could not be found. Sep 27 16:47:34.563610 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:47:34.563610 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:47:34.563610 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:47:34.563610 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:47:34.563610 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:47:34.563610 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:47:34.563610 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:47:34.563610 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:47:34.563610 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:47:34.565211 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:47:34.565211 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:47:34.565211 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:47:34.565211 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:47:34.565211 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:47:34.565211 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:47:34.565211 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:47:34.565211 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50687ace-d869-4712-9cf7-0d16c7244ac7 could not be found. Sep 27 16:47:34.565211 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:47:34.565211 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:47:34.565211 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:47:34.565211 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:47:34.565211 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:47:34.565211 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:47:34.565211 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:47:34.565211 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:47:34.565211 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50687ace-d869-4712-9cf7-0d16c7244ac7 could not be found. Sep 27 16:47:34.565211 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:47:34.566570 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d6279c52-57d2-4abb-8d75-2fd2d0c08873 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Returning 404 to user: Instance 50687ace-d869-4712-9cf7-0d16c7244ac7 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:47:34.566570 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d6279c52-57d2-4abb-8d75-2fd2d0c08873 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7" status: 404 len: 111 microversion: 2.1 time: 0.032634 Sep 27 16:47:34.566570 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 578/1106] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:34 2022] GET /compute/v2.1/servers/50687ace-d869-4712-9cf7-0d16c7244ac7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:47:35.322294 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-872e70ed-db44-4485-a727-e0d2aa76e91c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:35.322835 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-872e70ed-db44-4485-a727-e0d2aa76e91c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:35.329413 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-872e70ed-db44-4485-a727-e0d2aa76e91c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:35.329908 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-872e70ed-db44-4485-a727-e0d2aa76e91c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:35.330540 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-872e70ed-db44-4485-a727-e0d2aa76e91c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:35.331472 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-872e70ed-db44-4485-a727-e0d2aa76e91c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:35.331938 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-872e70ed-db44-4485-a727-e0d2aa76e91c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:35.332371 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-872e70ed-db44-4485-a727-e0d2aa76e91c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:35.346527 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-872e70ed-db44-4485-a727-e0d2aa76e91c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] HTTP exception thrown: Instance 3d959d05-2c44-4e4c-a8c0-9dd0b985b564 could not be found. Sep 27 16:47:35.348255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-872e70ed-db44-4485-a727-e0d2aa76e91c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Request method failure captured: Sep 27 16:47:35.348255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 HTTP/1.1 Sep 27 16:47:35.348255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:47:35.348255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:47:35.348255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:47:35.348255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 27 16:47:35.348255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:47:35.348255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:47:35.348255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:47:35.348255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:47:35.348255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMycmHtLFvrjDMir7PsAl0jrokT3pa5jWD2AqQrwOiXUSlp_VBcvOvskgl7hrGZA-R6N8tY93GKubrDEbGHZBxN-0A8f0iTnGL1Me323dLs24OolKvT3wb_agnoXINlz6fmbhBYmwIDMLWanClMBO1rnYG_y7132m0PKHDP3kJPGf9_I Sep 27 16:47:35.348255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:47:35.348255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:47:35.348255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:47:35.348255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:47:35.348255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:47:35.348255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:47:35.348255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: 1e0f894b53284e788cdb4864acd917be Sep 27 16:47:35.348255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-TestVolumeBootPattern-410545175 Sep 27 16:47:35.348255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:47:35.348255 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:47:35.349868 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e0f894b53284e788cdb4864acd917be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1e0f894b53284e788cdb4864acd917be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1e0f894b53284e788cdb4864acd917be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e0f894b53284e788cdb4864acd917be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:47:35.349868 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-TestVolumeBootPattern-410545175 Sep 27 16:47:35.349868 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 1e0f894b53284e788cdb4864acd917be Sep 27 16:47:35.349868 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-TestVolumeBootPattern-410545175 Sep 27 16:47:35.349868 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-TestVolumeBootPattern-410545175-project Sep 27 16:47:35.349868 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:47:35.349868 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:47:35.349868 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: 421aaa238a3c495096dfc55aba76267c Sep 27 16:47:35.349868 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-TestVolumeBootPattern-410545175-project Sep 27 16:47:35.349868 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: > Sep 27 16:47:35.349868 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Instance 3d959d05-2c44-4e4c-a8c0-9dd0b985b564 could not be found. Sep 27 16:47:35.349868 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'id': '3d959d05-2c44-4e4c-a8c0-9dd0b985b564'} Sep 27 16:47:35.350750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:47:35.350750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:47:35.350750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:47:35.350750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:47:35.350750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:47:35.350750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:47:35.350750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:47:35.350750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:47:35.350750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:47:35.350750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:47:35.350750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d959d05-2c44-4e4c-a8c0-9dd0b985b564 could not be found. Sep 27 16:47:35.350750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:47:35.350750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:47:35.350750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:47:35.350750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:47:35.350750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:47:35.350750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:47:35.350750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:47:35.350750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:47:35.350750 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:47:35.352363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:47:35.352363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 16:47:35.352363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 16:47:35.352363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 16:47:35.352363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 16:47:35.352363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:47:35.352363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:47:35.352363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:47:35.352363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:47:35.352363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d959d05-2c44-4e4c-a8c0-9dd0b985b564 could not be found. Sep 27 16:47:35.352363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:47:35.352363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:47:35.352363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:47:35.352363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:47:35.352363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:47:35.352363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:47:35.352363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:47:35.352363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:47:35.352363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d959d05-2c44-4e4c-a8c0-9dd0b985b564 could not be found. Sep 27 16:47:35.352363 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:47:35.354034 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-872e70ed-db44-4485-a727-e0d2aa76e91c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Returning 404 to user: Instance 3d959d05-2c44-4e4c-a8c0-9dd0b985b564 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:47:35.354034 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-872e70ed-db44-4485-a727-e0d2aa76e91c tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 404 len: 111 microversion: 2.1 time: 0.031502 Sep 27 16:47:35.354034 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 529/1107] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:47:35 2022] DELETE /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:47:35.359722 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-50aecd7e-ed23-410b-9e4d-4d53e78de26d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:35.360339 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-50aecd7e-ed23-410b-9e4d-4d53e78de26d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] [instance: 3d959d05-2c44-4e4c-a8c0-9dd0b985b564] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:35.366277 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50aecd7e-ed23-410b-9e4d-4d53e78de26d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:35.366765 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50aecd7e-ed23-410b-9e4d-4d53e78de26d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:35.367377 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50aecd7e-ed23-410b-9e4d-4d53e78de26d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:35.367921 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50aecd7e-ed23-410b-9e4d-4d53e78de26d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:35.368381 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50aecd7e-ed23-410b-9e4d-4d53e78de26d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:35.368807 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50aecd7e-ed23-410b-9e4d-4d53e78de26d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:35.382818 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-50aecd7e-ed23-410b-9e4d-4d53e78de26d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] HTTP exception thrown: Instance 3d959d05-2c44-4e4c-a8c0-9dd0b985b564 could not be found. Sep 27 16:47:35.384388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-50aecd7e-ed23-410b-9e4d-4d53e78de26d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Request method failure captured: Sep 27 16:47:35.384388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 HTTP/1.1 Sep 27 16:47:35.384388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:47:35.384388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:47:35.384388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:47:35.384388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:47:35.384388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:47:35.384388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:47:35.384388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:47:35.384388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:47:35.384388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMycmHtLFvrjDMir7PsAl0jrokT3pa5jWD2AqQrwOiXUSlp_VBcvOvskgl7hrGZA-R6N8tY93GKubrDEbGHZBxN-0A8f0iTnGL1Me323dLs24OolKvT3wb_agnoXINlz6fmbhBYmwIDMLWanClMBO1rnYG_y7132m0PKHDP3kJPGf9_I Sep 27 16:47:35.384388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:47:35.384388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:47:35.384388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:47:35.384388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:47:35.384388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:47:35.384388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:47:35.384388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 1e0f894b53284e788cdb4864acd917be Sep 27 16:47:35.384388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-TestVolumeBootPattern-410545175 Sep 27 16:47:35.384388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:47:35.384388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:47:35.386052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e0f894b53284e788cdb4864acd917be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1e0f894b53284e788cdb4864acd917be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1e0f894b53284e788cdb4864acd917be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e0f894b53284e788cdb4864acd917be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:47:35.386052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-TestVolumeBootPattern-410545175 Sep 27 16:47:35.386052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 1e0f894b53284e788cdb4864acd917be Sep 27 16:47:35.386052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-TestVolumeBootPattern-410545175 Sep 27 16:47:35.386052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-TestVolumeBootPattern-410545175-project Sep 27 16:47:35.386052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:47:35.386052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:47:35.386052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: 421aaa238a3c495096dfc55aba76267c Sep 27 16:47:35.386052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-TestVolumeBootPattern-410545175-project Sep 27 16:47:35.386052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:47:35.386052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Instance 3d959d05-2c44-4e4c-a8c0-9dd0b985b564 could not be found. Sep 27 16:47:35.386052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': '3d959d05-2c44-4e4c-a8c0-9dd0b985b564'} Sep 27 16:47:35.387090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:47:35.387090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:47:35.387090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:47:35.387090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:47:35.387090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:47:35.387090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:47:35.387090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:47:35.387090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:47:35.387090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:47:35.387090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:47:35.387090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d959d05-2c44-4e4c-a8c0-9dd0b985b564 could not be found. Sep 27 16:47:35.387090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:47:35.387090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:47:35.387090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:47:35.387090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:47:35.387090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:47:35.387090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:47:35.387090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:47:35.387090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:47:35.387090 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:47:35.388574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:47:35.388574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:47:35.388574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:47:35.388574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:47:35.388574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:47:35.388574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:47:35.388574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:47:35.388574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d959d05-2c44-4e4c-a8c0-9dd0b985b564 could not be found. Sep 27 16:47:35.388574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:47:35.388574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:47:35.388574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:47:35.388574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:47:35.388574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:47:35.388574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:47:35.388574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:47:35.388574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:47:35.388574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d959d05-2c44-4e4c-a8c0-9dd0b985b564 could not be found. Sep 27 16:47:35.388574 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:47:35.389962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-50aecd7e-ed23-410b-9e4d-4d53e78de26d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Returning 404 to user: Instance 3d959d05-2c44-4e4c-a8c0-9dd0b985b564 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:47:35.389962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-50aecd7e-ed23-410b-9e4d-4d53e78de26d tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564" status: 404 len: 111 microversion: 2.1 time: 0.030355 Sep 27 16:47:35.389962 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 579/1108] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:35 2022] GET /compute/v2.1/servers/3d959d05-2c44-4e4c-a8c0-9dd0b985b564 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:47:35.549629 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a548c69b-b173-469d-a435-2847a8d6327d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:35.550234 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a548c69b-b173-469d-a435-2847a8d6327d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:35.556814 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a548c69b-b173-469d-a435-2847a8d6327d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:35.557338 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a548c69b-b173-469d-a435-2847a8d6327d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:35.557852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a548c69b-b173-469d-a435-2847a8d6327d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:35.558546 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a548c69b-b173-469d-a435-2847a8d6327d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:35.559025 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a548c69b-b173-469d-a435-2847a8d6327d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:35.559446 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a548c69b-b173-469d-a435-2847a8d6327d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:35.716382 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a548c69b-b173-469d-a435-2847a8d6327d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:35.725037 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a548c69b-b173-469d-a435-2847a8d6327d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813" status: 200 len: 1362 microversion: 2.1 time: 0.180290 Sep 27 16:47:35.725605 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 530/1109] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:35 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:36.442758 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-27db67f0-c54c-45e7-9853-91ebb6689a4c req-70f0bbea-a0e5-4459-9474-c3a724fcf20c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56ed9350-a296-4795-959a-ce50eafb5813", "tag": "535083c1-2b25-4e68-97de-dca8c1b7f985"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:47:36.454057 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-27db67f0-c54c-45e7-9853-91ebb6689a4c req-70f0bbea-a0e5-4459-9474-c3a724fcf20c service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:36.457134 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-27db67f0-c54c-45e7-9853-91ebb6689a4c req-70f0bbea-a0e5-4459-9474-c3a724fcf20c service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:36.457134 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-27db67f0-c54c-45e7-9853-91ebb6689a4c req-70f0bbea-a0e5-4459-9474-c3a724fcf20c service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:36.467301 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-27db67f0-c54c-45e7-9853-91ebb6689a4c req-70f0bbea-a0e5-4459-9474-c3a724fcf20c service nova] Creating event network-changed:535083c1-2b25-4e68-97de-dca8c1b7f985 for instance 56ed9350-a296-4795-959a-ce50eafb5813 on hv-cinder-85506 Sep 27 16:47:36.472360 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-27db67f0-c54c-45e7-9853-91ebb6689a4c req-70f0bbea-a0e5-4459-9474-c3a724fcf20c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033089 Sep 27 16:47:36.473070 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 580/1110] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:47:36.747985 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7922e4a4-7bcd-4d69-9f8b-5cc870ce4fe4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:36.749097 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7922e4a4-7bcd-4d69-9f8b-5cc870ce4fe4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:36.757870 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7922e4a4-7bcd-4d69-9f8b-5cc870ce4fe4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:36.759320 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7922e4a4-7bcd-4d69-9f8b-5cc870ce4fe4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:36.759879 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7922e4a4-7bcd-4d69-9f8b-5cc870ce4fe4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:36.761093 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7922e4a4-7bcd-4d69-9f8b-5cc870ce4fe4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:36.761912 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7922e4a4-7bcd-4d69-9f8b-5cc870ce4fe4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:36.763027 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7922e4a4-7bcd-4d69-9f8b-5cc870ce4fe4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:36.768654 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:47:36.941546 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7922e4a4-7bcd-4d69-9f8b-5cc870ce4fe4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:36.949685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7922e4a4-7bcd-4d69-9f8b-5cc870ce4fe4 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813" status: 200 len: 1362 microversion: 2.1 time: 0.205678 Sep 27 16:47:36.950821 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 531/1111] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:36 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:37.007438 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e4555992-9883-439e-8e13-8848b8667d94 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] Calling method '.version_select at 0x7fa4090c39d0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:37.099704 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e4555992-9883-439e-8e13-8848b8667d94 tempest-TestVolumeBootPattern-410545175 tempest-TestVolumeBootPattern-410545175-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-878616145" status: 202 len: 0 microversion: 2.1 time: 0.096700 Sep 27 16:47:37.100300 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 581/1112] 10.222.0.64 () {58 vars in 1260 bytes} [Tue Sep 27 16:47:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-878616145 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 16:47:37.275052 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-16d1a11a-4450-4063-85a9-130304327d9a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:37.277729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-16d1a11a-4450-4063-85a9-130304327d9a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:37.282441 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-16d1a11a-4450-4063-85a9-130304327d9a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:37.283070 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-16d1a11a-4450-4063-85a9-130304327d9a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:37.283506 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-16d1a11a-4450-4063-85a9-130304327d9a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:37.284221 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-16d1a11a-4450-4063-85a9-130304327d9a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:37.284729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-16d1a11a-4450-4063-85a9-130304327d9a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:37.285094 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-16d1a11a-4450-4063-85a9-130304327d9a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:37.331436 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-16d1a11a-4450-4063-85a9-130304327d9a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 16:47:37.625879 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-16d1a11a-4450-4063-85a9-130304327d9a tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "DELETE /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 204 len: 0 microversion: 2.1 time: 0.353410 Sep 27 16:47:37.630698 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 532/1113] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:47:37 2022] DELETE /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 16:47:37.634882 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-78b4df8d-1683-4184-8f48-b93d5819a03c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:37.635624 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-78b4df8d-1683-4184-8f48-b93d5819a03c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:37.641976 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78b4df8d-1683-4184-8f48-b93d5819a03c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:37.642460 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78b4df8d-1683-4184-8f48-b93d5819a03c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:37.642920 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78b4df8d-1683-4184-8f48-b93d5819a03c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:37.643623 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78b4df8d-1683-4184-8f48-b93d5819a03c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:37.644133 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78b4df8d-1683-4184-8f48-b93d5819a03c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:37.644760 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78b4df8d-1683-4184-8f48-b93d5819a03c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:37.974149 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7f9197eb-11f6-4ac2-8b78-37528e3b77aa tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:37.974878 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7f9197eb-11f6-4ac2-8b78-37528e3b77aa tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:37.977337 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=4 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:47:37.982516 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f9197eb-11f6-4ac2-8b78-37528e3b77aa tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:37.983119 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f9197eb-11f6-4ac2-8b78-37528e3b77aa tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:37.983608 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f9197eb-11f6-4ac2-8b78-37528e3b77aa tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:37.984922 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f9197eb-11f6-4ac2-8b78-37528e3b77aa tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:37.985544 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f9197eb-11f6-4ac2-8b78-37528e3b77aa tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:37.986098 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f9197eb-11f6-4ac2-8b78-37528e3b77aa tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:38.156729 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-78b4df8d-1683-4184-8f48-b93d5819a03c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:38.160657 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:47:38.166603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-78b4df8d-1683-4184-8f48-b93d5819a03c tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1571 microversion: 2.1 time: 0.535701 Sep 27 16:47:38.167427 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 582/1114] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:37 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1571 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:38.288146 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7f9197eb-11f6-4ac2-8b78-37528e3b77aa tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:38.298518 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7f9197eb-11f6-4ac2-8b78-37528e3b77aa tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813" status: 200 len: 1362 microversion: 2.1 time: 0.328640 Sep 27 16:47:38.299479 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 533/1115] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:37 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 => generated 1362 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:47:38.489156 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-55080a70-3f0a-457a-90d2-25deb9d61390 req-b34b8f5d-cdce-4d64-b1fb-397a2962b3e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800233b1-cc79-4eb5-9cdf-ff21e8321268", "tag": "c6777043-34a8-4a48-b945-7f80df4e0022"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:47:38.499286 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-55080a70-3f0a-457a-90d2-25deb9d61390 req-b34b8f5d-cdce-4d64-b1fb-397a2962b3e2 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:38.499958 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-55080a70-3f0a-457a-90d2-25deb9d61390 req-b34b8f5d-cdce-4d64-b1fb-397a2962b3e2 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:38.500519 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-55080a70-3f0a-457a-90d2-25deb9d61390 req-b34b8f5d-cdce-4d64-b1fb-397a2962b3e2 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:38.512112 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-55080a70-3f0a-457a-90d2-25deb9d61390 req-b34b8f5d-cdce-4d64-b1fb-397a2962b3e2 service nova] Creating event network-changed:c6777043-34a8-4a48-b945-7f80df4e0022 for instance 800233b1-cc79-4eb5-9cdf-ff21e8321268 on hv-cinder-85506 Sep 27 16:47:38.516984 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-55080a70-3f0a-457a-90d2-25deb9d61390 req-b34b8f5d-cdce-4d64-b1fb-397a2962b3e2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031458 Sep 27 16:47:38.517573 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 583/1116] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:47:39.191801 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d8073de8-ee4b-4354-9949-0aa9fbda9cf0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:39.192409 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d8073de8-ee4b-4354-9949-0aa9fbda9cf0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:39.199204 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8073de8-ee4b-4354-9949-0aa9fbda9cf0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:39.199694 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8073de8-ee4b-4354-9949-0aa9fbda9cf0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:39.200123 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8073de8-ee4b-4354-9949-0aa9fbda9cf0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:39.200929 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8073de8-ee4b-4354-9949-0aa9fbda9cf0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:39.201448 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8073de8-ee4b-4354-9949-0aa9fbda9cf0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:39.201869 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8073de8-ee4b-4354-9949-0aa9fbda9cf0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:39.322515 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3722695e-09c6-47de-a243-b4457c069a9f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:39.323256 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3722695e-09c6-47de-a243-b4457c069a9f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:39.335591 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3722695e-09c6-47de-a243-b4457c069a9f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:39.336092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3722695e-09c6-47de-a243-b4457c069a9f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:39.336536 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3722695e-09c6-47de-a243-b4457c069a9f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:39.337860 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3722695e-09c6-47de-a243-b4457c069a9f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:39.337860 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3722695e-09c6-47de-a243-b4457c069a9f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:39.338095 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3722695e-09c6-47de-a243-b4457c069a9f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:39.477035 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d8073de8-ee4b-4354-9949-0aa9fbda9cf0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:39.486145 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d8073de8-ee4b-4354-9949-0aa9fbda9cf0 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1571 microversion: 2.1 time: 0.298947 Sep 27 16:47:39.486732 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 534/1117] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:39 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1571 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:39.528458 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3722695e-09c6-47de-a243-b4457c069a9f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:39.536615 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3722695e-09c6-47de-a243-b4457c069a9f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813" status: 200 len: 1362 microversion: 2.1 time: 0.218758 Sep 27 16:47:39.537182 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 584/1118] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:39 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:47:40.516745 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e5ec36ba-c8e3-40d6-8117-0a7b13d23d27 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:40.518376 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e5ec36ba-c8e3-40d6-8117-0a7b13d23d27 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:40.534389 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e5ec36ba-c8e3-40d6-8117-0a7b13d23d27 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:40.535250 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e5ec36ba-c8e3-40d6-8117-0a7b13d23d27 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:40.535685 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e5ec36ba-c8e3-40d6-8117-0a7b13d23d27 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:40.536391 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e5ec36ba-c8e3-40d6-8117-0a7b13d23d27 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:40.536841 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e5ec36ba-c8e3-40d6-8117-0a7b13d23d27 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:40.537324 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e5ec36ba-c8e3-40d6-8117-0a7b13d23d27 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:40.561444 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-67615468-4521-49d6-a700-43d58e7e870e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:40.562556 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-67615468-4521-49d6-a700-43d58e7e870e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:40.569629 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-67615468-4521-49d6-a700-43d58e7e870e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:40.570992 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-67615468-4521-49d6-a700-43d58e7e870e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:40.571513 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-67615468-4521-49d6-a700-43d58e7e870e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:40.573501 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-67615468-4521-49d6-a700-43d58e7e870e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:40.574096 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-67615468-4521-49d6-a700-43d58e7e870e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:40.574675 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-67615468-4521-49d6-a700-43d58e7e870e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:40.926937 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:47:40.940400 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e5ec36ba-c8e3-40d6-8117-0a7b13d23d27 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:40.948579 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e5ec36ba-c8e3-40d6-8117-0a7b13d23d27 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1571 microversion: 2.1 time: 0.441976 Sep 27 16:47:40.949426 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 535/1119] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:40 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1571 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:40.982138 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-67615468-4521-49d6-a700-43d58e7e870e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:40.990833 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-67615468-4521-49d6-a700-43d58e7e870e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813" status: 200 len: 1362 microversion: 2.1 time: 0.435351 Sep 27 16:47:40.991938 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 585/1120] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:40 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 => generated 1362 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:41.403723 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-3e4668a5-3a8d-45f2-9af6-3ba6111aead7 req-7c7c83e2-dad1-4397-8115-a50d12ab03ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800233b1-cc79-4eb5-9cdf-ff21e8321268", "name": "network-vif-deleted", "tag": "c6777043-34a8-4a48-b945-7f80df4e0022"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:47:41.415362 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-3e4668a5-3a8d-45f2-9af6-3ba6111aead7 req-7c7c83e2-dad1-4397-8115-a50d12ab03ba service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:41.415869 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-3e4668a5-3a8d-45f2-9af6-3ba6111aead7 req-7c7c83e2-dad1-4397-8115-a50d12ab03ba service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:41.416447 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-3e4668a5-3a8d-45f2-9af6-3ba6111aead7 req-7c7c83e2-dad1-4397-8115-a50d12ab03ba service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:41.428476 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-3e4668a5-3a8d-45f2-9af6-3ba6111aead7 req-7c7c83e2-dad1-4397-8115-a50d12ab03ba service nova] Creating event network-vif-deleted:c6777043-34a8-4a48-b945-7f80df4e0022 for instance 800233b1-cc79-4eb5-9cdf-ff21e8321268 on hv-cinder-85506 Sep 27 16:47:41.433262 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-3e4668a5-3a8d-45f2-9af6-3ba6111aead7 req-7c7c83e2-dad1-4397-8115-a50d12ab03ba service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034767 Sep 27 16:47:41.433852 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 536/1121] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:47:41.983060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=8 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:47:42.018591 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-229b5735-4095-4d6e-a353-6d5e7513ec03 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:42.019482 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-229b5735-4095-4d6e-a353-6d5e7513ec03 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:42.034536 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-229b5735-4095-4d6e-a353-6d5e7513ec03 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:42.035164 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-229b5735-4095-4d6e-a353-6d5e7513ec03 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:42.035682 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-229b5735-4095-4d6e-a353-6d5e7513ec03 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:42.037639 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-229b5735-4095-4d6e-a353-6d5e7513ec03 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:42.038351 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-229b5735-4095-4d6e-a353-6d5e7513ec03 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:42.040778 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-229b5735-4095-4d6e-a353-6d5e7513ec03 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:42.062908 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ac2f492e-2e90-4618-baba-50dd7d4d5bb5 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:42.063739 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ac2f492e-2e90-4618-baba-50dd7d4d5bb5 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:42.070048 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac2f492e-2e90-4618-baba-50dd7d4d5bb5 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:42.070902 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac2f492e-2e90-4618-baba-50dd7d4d5bb5 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:42.071568 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac2f492e-2e90-4618-baba-50dd7d4d5bb5 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:42.072333 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac2f492e-2e90-4618-baba-50dd7d4d5bb5 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:42.072954 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac2f492e-2e90-4618-baba-50dd7d4d5bb5 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:42.073534 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac2f492e-2e90-4618-baba-50dd7d4d5bb5 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:42.191517 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ac2f492e-2e90-4618-baba-50dd7d4d5bb5 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:42.197301 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ac2f492e-2e90-4618-baba-50dd7d4d5bb5 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1220 microversion: 2.1 time: 0.226704 Sep 27 16:47:42.197868 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 586/1122] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:41 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1220 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:42.276714 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-053dab91-0d8c-4799-9875-368e416b79de req-a1adf2f2-da0e-40a5-bea6-fa5e7c8e94b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56ed9350-a296-4795-959a-ce50eafb5813", "name": "network-vif-plugged", "status": "completed", "tag": "535083c1-2b25-4e68-97de-dca8c1b7f985"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:47:42.286829 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-053dab91-0d8c-4799-9875-368e416b79de req-a1adf2f2-da0e-40a5-bea6-fa5e7c8e94b2 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:42.287319 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-053dab91-0d8c-4799-9875-368e416b79de req-a1adf2f2-da0e-40a5-bea6-fa5e7c8e94b2 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:42.287757 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-053dab91-0d8c-4799-9875-368e416b79de req-a1adf2f2-da0e-40a5-bea6-fa5e7c8e94b2 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:42.299875 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-053dab91-0d8c-4799-9875-368e416b79de req-a1adf2f2-da0e-40a5-bea6-fa5e7c8e94b2 service nova] Creating event network-vif-plugged:535083c1-2b25-4e68-97de-dca8c1b7f985 for instance 56ed9350-a296-4795-959a-ce50eafb5813 on hv-cinder-85506 Sep 27 16:47:42.306330 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-053dab91-0d8c-4799-9875-368e416b79de req-a1adf2f2-da0e-40a5-bea6-fa5e7c8e94b2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102151 Sep 27 16:47:42.306951 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 587/1123] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:47:42.335665 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-229b5735-4095-4d6e-a353-6d5e7513ec03 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:42.353186 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-229b5735-4095-4d6e-a353-6d5e7513ec03 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813" status: 200 len: 1362 microversion: 2.1 time: 0.339608 Sep 27 16:47:42.353876 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 537/1124] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:42 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:47:43.222086 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1bc1100b-8f92-423d-8425-be98812c760b tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:43.222926 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1bc1100b-8f92-423d-8425-be98812c760b tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:43.229422 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bc1100b-8f92-423d-8425-be98812c760b tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:43.229983 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bc1100b-8f92-423d-8425-be98812c760b tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:43.230425 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bc1100b-8f92-423d-8425-be98812c760b tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:43.231145 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bc1100b-8f92-423d-8425-be98812c760b tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:43.231636 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bc1100b-8f92-423d-8425-be98812c760b tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:43.232029 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bc1100b-8f92-423d-8425-be98812c760b tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:43.263823 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bc1100b-8f92-423d-8425-be98812c760b tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:43.264304 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bc1100b-8f92-423d-8425-be98812c760b tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:43.264742 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bc1100b-8f92-423d-8425-be98812c760b tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:43.265250 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-1bc1100b-8f92-423d-8425-be98812c760b tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lazy-loading 'fault' on Instance uuid 800233b1-cc79-4eb5-9cdf-ff21e8321268 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:47:43.307748 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1bc1100b-8f92-423d-8425-be98812c760b tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5c944405e8435f9e0eccaaee764cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb77c9fe25cb4abda83cb3d2e665557a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:43.315598 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1bc1100b-8f92-423d-8425-be98812c760b tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 200 len: 1225 microversion: 2.1 time: 0.098628 Sep 27 16:47:43.316167 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 588/1125] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:43 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:43.379788 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dffdf140-9e19-4658-ae42-622f9f6bac5b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:43.380419 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-dffdf140-9e19-4658-ae42-622f9f6bac5b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:43.387232 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dffdf140-9e19-4658-ae42-622f9f6bac5b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:43.387802 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dffdf140-9e19-4658-ae42-622f9f6bac5b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:43.388239 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dffdf140-9e19-4658-ae42-622f9f6bac5b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:43.388942 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dffdf140-9e19-4658-ae42-622f9f6bac5b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:43.389582 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dffdf140-9e19-4658-ae42-622f9f6bac5b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:43.390537 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dffdf140-9e19-4658-ae42-622f9f6bac5b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:43.632305 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dffdf140-9e19-4658-ae42-622f9f6bac5b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:43.640408 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-dffdf140-9e19-4658-ae42-622f9f6bac5b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813" status: 200 len: 1362 microversion: 2.1 time: 0.264105 Sep 27 16:47:43.640985 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 538/1126] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:43 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:44.340788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f5f5e6ca-705d-40b1-83ad-094bf36de8e4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:44.341789 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f5f5e6ca-705d-40b1-83ad-094bf36de8e4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] [instance: 800233b1-cc79-4eb5-9cdf-ff21e8321268] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:44.348217 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5f5e6ca-705d-40b1-83ad-094bf36de8e4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:44.348953 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5f5e6ca-705d-40b1-83ad-094bf36de8e4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:44.349508 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5f5e6ca-705d-40b1-83ad-094bf36de8e4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:44.350316 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5f5e6ca-705d-40b1-83ad-094bf36de8e4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:44.350883 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5f5e6ca-705d-40b1-83ad-094bf36de8e4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:44.351407 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5f5e6ca-705d-40b1-83ad-094bf36de8e4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:44.366865 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-f5f5e6ca-705d-40b1-83ad-094bf36de8e4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] HTTP exception thrown: Instance 800233b1-cc79-4eb5-9cdf-ff21e8321268 could not be found. Sep 27 16:47:44.368728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f5f5e6ca-705d-40b1-83ad-094bf36de8e4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Request method failure captured: Sep 27 16:47:44.368728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 HTTP/1.1 Sep 27 16:47:44.368728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:47:44.368728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:47:44.368728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:47:44.368728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:47:44.368728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:47:44.368728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:47:44.368728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:47:44.368728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:47:44.368728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMyf3HEDY7jPGNuxNLHeQ0_xtoYfYQggloGCtpVF4rCxjlTUHuDRRYwMwmP7nusYcCQSVKKsUEuLH9EUUUpiko0r3F43s16E4bhloLzIVa8R0L4tayxM_9uFGsHu9oI6DXFE2LrukbLU4egP_-5_1J2k-RXztl_vqMwTdahCyvjbpya0 Sep 27 16:47:44.368728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:47:44.368728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:47:44.368728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:47:44.368728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:47:44.368728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:47:44.368728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:47:44.368728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: eb77c9fe25cb4abda83cb3d2e665557a Sep 27 16:47:44.368728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-TestShelveInstance-253178973 Sep 27 16:47:44.368728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:47:44.368728 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:47:44.370166 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb77c9fe25cb4abda83cb3d2e665557a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_eb77c9fe25cb4abda83cb3d2e665557a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/eb77c9fe25cb4abda83cb3d2e665557a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb77c9fe25cb4abda83cb3d2e665557a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:47:44.370166 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-TestShelveInstance-253178973 Sep 27 16:47:44.370166 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: eb77c9fe25cb4abda83cb3d2e665557a Sep 27 16:47:44.370166 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-TestShelveInstance-253178973 Sep 27 16:47:44.370166 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-TestShelveInstance-253178973-project Sep 27 16:47:44.370166 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:47:44.370166 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:47:44.370166 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: af5c944405e8435f9e0eccaaee764cd2 Sep 27 16:47:44.370166 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-TestShelveInstance-253178973-project Sep 27 16:47:44.370166 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:47:44.370166 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Instance 800233b1-cc79-4eb5-9cdf-ff21e8321268 could not be found. Sep 27 16:47:44.370166 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': '800233b1-cc79-4eb5-9cdf-ff21e8321268'} Sep 27 16:47:44.371160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:47:44.371160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:47:44.371160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:47:44.371160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:47:44.371160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:47:44.371160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:47:44.371160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:47:44.371160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:47:44.371160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:47:44.371160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:47:44.371160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800233b1-cc79-4eb5-9cdf-ff21e8321268 could not be found. Sep 27 16:47:44.371160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:47:44.371160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:47:44.371160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:47:44.371160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:47:44.371160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:47:44.371160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:47:44.371160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:47:44.371160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:47:44.371160 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:47:44.372590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:47:44.372590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:47:44.372590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:47:44.372590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:47:44.372590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:47:44.372590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:47:44.372590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:47:44.372590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800233b1-cc79-4eb5-9cdf-ff21e8321268 could not be found. Sep 27 16:47:44.372590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:47:44.372590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:47:44.372590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:47:44.372590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:47:44.372590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:47:44.372590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:47:44.372590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:47:44.372590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:47:44.372590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800233b1-cc79-4eb5-9cdf-ff21e8321268 could not be found. Sep 27 16:47:44.372590 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:47:44.375901 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f5f5e6ca-705d-40b1-83ad-094bf36de8e4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Returning 404 to user: Instance 800233b1-cc79-4eb5-9cdf-ff21e8321268 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:47:44.375901 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f5f5e6ca-705d-40b1-83ad-094bf36de8e4 tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268" status: 404 len: 111 microversion: 2.1 time: 0.034472 Sep 27 16:47:44.375901 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 589/1127] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:44 2022] GET /compute/v2.1/servers/800233b1-cc79-4eb5-9cdf-ff21e8321268 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:47:44.641745 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-facbd36d-0ffb-4e9b-a78f-b01a9063387e tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] Calling method '.version_select at 0x7fa405888e50>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:44.666752 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-540e79c8-ea4f-43d2-aebe-f8df7e06f480 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:44.667594 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-540e79c8-ea4f-43d2-aebe-f8df7e06f480 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:44.675383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-540e79c8-ea4f-43d2-aebe-f8df7e06f480 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:44.675884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-540e79c8-ea4f-43d2-aebe-f8df7e06f480 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:44.676380 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-540e79c8-ea4f-43d2-aebe-f8df7e06f480 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:44.677128 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-540e79c8-ea4f-43d2-aebe-f8df7e06f480 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:44.677661 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-540e79c8-ea4f-43d2-aebe-f8df7e06f480 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:44.678025 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-540e79c8-ea4f-43d2-aebe-f8df7e06f480 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:44.755977 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-facbd36d-0ffb-4e9b-a78f-b01a9063387e tempest-TestShelveInstance-253178973 tempest-TestShelveInstance-253178973-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1242109760" status: 202 len: 0 microversion: 2.1 time: 0.118428 Sep 27 16:47:44.756823 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 539/1128] 10.222.0.64 () {58 vars in 1254 bytes} [Tue Sep 27 16:47:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1242109760 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 16:47:45.022294 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-540e79c8-ea4f-43d2-aebe-f8df7e06f480 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:45.030364 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-540e79c8-ea4f-43d2-aebe-f8df7e06f480 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813" status: 200 len: 1362 microversion: 2.1 time: 0.367745 Sep 27 16:47:45.033043 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 590/1129] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:44 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 => generated 1362 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:46.056009 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d6d87feb-2ef8-4397-9ae6-b163bb9be481 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:46.058311 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d6d87feb-2ef8-4397-9ae6-b163bb9be481 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:46.067934 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6d87feb-2ef8-4397-9ae6-b163bb9be481 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:46.068950 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6d87feb-2ef8-4397-9ae6-b163bb9be481 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:46.069753 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6d87feb-2ef8-4397-9ae6-b163bb9be481 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:46.070754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6d87feb-2ef8-4397-9ae6-b163bb9be481 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:46.071565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6d87feb-2ef8-4397-9ae6-b163bb9be481 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:46.072293 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6d87feb-2ef8-4397-9ae6-b163bb9be481 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:46.637706 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d6d87feb-2ef8-4397-9ae6-b163bb9be481 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:47:46.648129 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d6d87feb-2ef8-4397-9ae6-b163bb9be481 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813" status: 200 len: 1548 microversion: 2.1 time: 0.597894 Sep 27 16:47:46.663383 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 540/1130] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:47:46 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 => generated 1548 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:47:46.672770 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9af5b0b7-e0e6-4d6a-8b79-ab32640d1ead tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:47:46.673563 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9af5b0b7-e0e6-4d6a-8b79-ab32640d1ead tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:47:46.676588 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:47:46.681344 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9af5b0b7-e0e6-4d6a-8b79-ab32640d1ead tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:46.682020 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9af5b0b7-e0e6-4d6a-8b79-ab32640d1ead tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:46.682933 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9af5b0b7-e0e6-4d6a-8b79-ab32640d1ead tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:46.684097 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9af5b0b7-e0e6-4d6a-8b79-ab32640d1ead tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:46.684734 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9af5b0b7-e0e6-4d6a-8b79-ab32640d1ead tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:46.685334 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9af5b0b7-e0e6-4d6a-8b79-ab32640d1ead tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:46.808277 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9af5b0b7-e0e6-4d6a-8b79-ab32640d1ead tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.140331 Sep 27 16:47:46.808866 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 591/1131] 10.222.0.64 () {58 vars in 1275 bytes} [Tue Sep 27 16:47:46 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 16:47:48.390661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-75d34445-9e97-43fc-9f96-a42452db1f77 req-b7e10bbb-69b9-434f-8f3a-040537e35977 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56ed9350-a296-4795-959a-ce50eafb5813", "tag": "535083c1-2b25-4e68-97de-dca8c1b7f985"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:47:48.403577 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-75d34445-9e97-43fc-9f96-a42452db1f77 req-b7e10bbb-69b9-434f-8f3a-040537e35977 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:47:48.404376 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-75d34445-9e97-43fc-9f96-a42452db1f77 req-b7e10bbb-69b9-434f-8f3a-040537e35977 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:47:48.405078 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-75d34445-9e97-43fc-9f96-a42452db1f77 req-b7e10bbb-69b9-434f-8f3a-040537e35977 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:47:48.422123 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-75d34445-9e97-43fc-9f96-a42452db1f77 req-b7e10bbb-69b9-434f-8f3a-040537e35977 service nova] Creating event network-changed:535083c1-2b25-4e68-97de-dca8c1b7f985 for instance 56ed9350-a296-4795-959a-ce50eafb5813 on hv-cinder-85506 Sep 27 16:47:48.440299 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-75d34445-9e97-43fc-9f96-a42452db1f77 req-b7e10bbb-69b9-434f-8f3a-040537e35977 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057229 Sep 27 16:47:48.458694 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 541/1132] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:48:22.351324 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=42 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:48:22.355194 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-dbe19fe8-c6df-49a2-8fdf-9e960bc3f166 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:48:22.355682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-dbe19fe8-c6df-49a2-8fdf-9e960bc3f166 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:48:22.361980 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dbe19fe8-c6df-49a2-8fdf-9e960bc3f166 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:22.366755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dbe19fe8-c6df-49a2-8fdf-9e960bc3f166 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:22.366755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dbe19fe8-c6df-49a2-8fdf-9e960bc3f166 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:22.366755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dbe19fe8-c6df-49a2-8fdf-9e960bc3f166 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:22.366755 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dbe19fe8-c6df-49a2-8fdf-9e960bc3f166 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:22.367204 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dbe19fe8-c6df-49a2-8fdf-9e960bc3f166 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:22.387846 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-dbe19fe8-c6df-49a2-8fdf-9e960bc3f166 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/ips" status: 200 len: 146 microversion: 2.1 time: 0.038053 Sep 27 16:48:22.388399 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 592/1133] 10.222.0.64 () {58 vars in 1248 bytes} [Tue Sep 27 16:48:22 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:48:23.934414 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:48:23.935226 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:48:23.939565 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-042aadd3-d69b-4f22-9f89-89323a1418c1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbfac677-dd20-4617-acc8-c8ae3457adb8"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:48:23.942084 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-042aadd3-d69b-4f22-9f89-89323a1418c1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:48:23.952654 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-042aadd3-d69b-4f22-9f89-89323a1418c1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:23.952654 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-042aadd3-d69b-4f22-9f89-89323a1418c1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:23.952654 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-042aadd3-d69b-4f22-9f89-89323a1418c1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:23.952654 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-042aadd3-d69b-4f22-9f89-89323a1418c1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:23.953036 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-042aadd3-d69b-4f22-9f89-89323a1418c1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:23.953036 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-042aadd3-d69b-4f22-9f89-89323a1418c1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:24.684552 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-042aadd3-d69b-4f22-9f89-89323a1418c1 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "POST /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.751870 Sep 27 16:48:24.685208 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 542/1134] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Sep 27 16:48:23 2022] POST /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-volume_attachments => generated 194 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:48:32.222740 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-81dd5b11-ea1d-46e3-8f53-2537ad29a98b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:48:32.225760 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-81dd5b11-ea1d-46e3-8f53-2537ad29a98b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:48:32.232025 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-81dd5b11-ea1d-46e3-8f53-2537ad29a98b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:32.232518 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-81dd5b11-ea1d-46e3-8f53-2537ad29a98b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:32.232960 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-81dd5b11-ea1d-46e3-8f53-2537ad29a98b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:32.233658 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-81dd5b11-ea1d-46e3-8f53-2537ad29a98b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:32.234121 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-81dd5b11-ea1d-46e3-8f53-2537ad29a98b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:32.234555 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-81dd5b11-ea1d-46e3-8f53-2537ad29a98b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:32.264307 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-81dd5b11-ea1d-46e3-8f53-2537ad29a98b tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046087 Sep 27 16:48:32.264860 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 593/1135] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Sep 27 16:48:32 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:48:32.276809 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ef64aa03-1f66-4823-9cc6-7397686a28b3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:48:32.277415 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ef64aa03-1f66-4823-9cc6-7397686a28b3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:48:32.283489 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef64aa03-1f66-4823-9cc6-7397686a28b3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:32.283961 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef64aa03-1f66-4823-9cc6-7397686a28b3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:32.284395 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef64aa03-1f66-4823-9cc6-7397686a28b3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:32.285074 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef64aa03-1f66-4823-9cc6-7397686a28b3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:32.285522 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef64aa03-1f66-4823-9cc6-7397686a28b3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:32.286533 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef64aa03-1f66-4823-9cc6-7397686a28b3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:32.315389 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ef64aa03-1f66-4823-9cc6-7397686a28b3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-volume_attachments/bbfac677-dd20-4617-acc8-c8ae3457adb8" status: 200 len: 194 microversion: 2.1 time: 0.043395 Sep 27 16:48:32.315951 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 543/1136] 10.222.0.64 () {58 vars in 1413 bytes} [Tue Sep 27 16:48:32 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-volume_attachments/bbfac677-dd20-4617-acc8-c8ae3457adb8 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:48:33.947853 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bf6bf91b-a2a4-49b0-836b-3a2cc7dc614d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e9a1de4-c2db-45ba-a810-4beb7b8a1aec"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:48:33.950632 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bf6bf91b-a2a4-49b0-836b-3a2cc7dc614d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:48:33.956694 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf6bf91b-a2a4-49b0-836b-3a2cc7dc614d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:33.957183 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf6bf91b-a2a4-49b0-836b-3a2cc7dc614d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:33.957619 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf6bf91b-a2a4-49b0-836b-3a2cc7dc614d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:33.959048 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf6bf91b-a2a4-49b0-836b-3a2cc7dc614d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:33.959524 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf6bf91b-a2a4-49b0-836b-3a2cc7dc614d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:33.959959 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf6bf91b-a2a4-49b0-836b-3a2cc7dc614d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:34.729912 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bf6bf91b-a2a4-49b0-836b-3a2cc7dc614d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "POST /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.785872 Sep 27 16:48:34.730516 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 594/1137] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Sep 27 16:48:33 2022] POST /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-volume_attachments => generated 194 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:48:43.316139 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-464603ad-6332-40c3-9d8b-b2d9af8cbeb8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:48:43.318420 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-464603ad-6332-40c3-9d8b-b2d9af8cbeb8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:48:43.321669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=4 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:48:43.322324 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:48:43.328983 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-464603ad-6332-40c3-9d8b-b2d9af8cbeb8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:43.328983 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-464603ad-6332-40c3-9d8b-b2d9af8cbeb8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:43.328983 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-464603ad-6332-40c3-9d8b-b2d9af8cbeb8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:43.328983 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-464603ad-6332-40c3-9d8b-b2d9af8cbeb8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:43.329474 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-464603ad-6332-40c3-9d8b-b2d9af8cbeb8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:43.329474 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-464603ad-6332-40c3-9d8b-b2d9af8cbeb8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:43.360943 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-464603ad-6332-40c3-9d8b-b2d9af8cbeb8 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048632 Sep 27 16:48:43.361514 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 544/1138] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Sep 27 16:48:43 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:48:43.552975 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-47313917-e41a-4d3a-9b60-aa73948d7092 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:48:43.553550 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-47313917-e41a-4d3a-9b60-aa73948d7092 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:48:43.560849 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-47313917-e41a-4d3a-9b60-aa73948d7092 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:43.561327 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-47313917-e41a-4d3a-9b60-aa73948d7092 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:43.561760 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-47313917-e41a-4d3a-9b60-aa73948d7092 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:43.562446 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-47313917-e41a-4d3a-9b60-aa73948d7092 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:43.562926 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-47313917-e41a-4d3a-9b60-aa73948d7092 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:43.563349 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-47313917-e41a-4d3a-9b60-aa73948d7092 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:43.592261 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-47313917-e41a-4d3a-9b60-aa73948d7092 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-volume_attachments/bbfac677-dd20-4617-acc8-c8ae3457adb8" status: 200 len: 194 microversion: 2.1 time: 0.044230 Sep 27 16:48:43.592834 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 595/1139] 10.222.0.64 () {58 vars in 1413 bytes} [Tue Sep 27 16:48:43 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-volume_attachments/bbfac677-dd20-4617-acc8-c8ae3457adb8 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:48:43.603633 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e1c2f1de-77da-4e52-a2a0-171519f2c711 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:48:43.604161 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e1c2f1de-77da-4e52-a2a0-171519f2c711 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:48:43.610914 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1c2f1de-77da-4e52-a2a0-171519f2c711 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:43.611402 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1c2f1de-77da-4e52-a2a0-171519f2c711 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:43.611839 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1c2f1de-77da-4e52-a2a0-171519f2c711 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:43.612531 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1c2f1de-77da-4e52-a2a0-171519f2c711 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:43.612986 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1c2f1de-77da-4e52-a2a0-171519f2c711 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:43.613410 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1c2f1de-77da-4e52-a2a0-171519f2c711 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:43.694269 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-e1c2f1de-77da-4e52-a2a0-171519f2c711 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lazy-loading 'services' on Instance uuid 56ed9350-a296-4795-959a-ce50eafb5813 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:48:43.908207 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e1c2f1de-77da-4e52-a2a0-171519f2c711 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "DELETE /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-volume_attachments/bbfac677-dd20-4617-acc8-c8ae3457adb8" status: 202 len: 0 microversion: 2.1 time: 0.308721 Sep 27 16:48:43.908772 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 545/1140] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Sep 27 16:48:43 2022] DELETE /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-volume_attachments/bbfac677-dd20-4617-acc8-c8ae3457adb8 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:48:46.084691 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8c126b46-9661-4351-92c3-d3e9c00a014f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:48:46.085195 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8c126b46-9661-4351-92c3-d3e9c00a014f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:48:46.091902 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c126b46-9661-4351-92c3-d3e9c00a014f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:46.092388 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c126b46-9661-4351-92c3-d3e9c00a014f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:46.092827 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c126b46-9661-4351-92c3-d3e9c00a014f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:46.093518 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c126b46-9661-4351-92c3-d3e9c00a014f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:46.093977 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c126b46-9661-4351-92c3-d3e9c00a014f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:46.094404 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c126b46-9661-4351-92c3-d3e9c00a014f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:46.123379 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8c126b46-9661-4351-92c3-d3e9c00a014f tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-volume_attachments/3e9a1de4-c2db-45ba-a810-4beb7b8a1aec" status: 200 len: 194 microversion: 2.1 time: 0.042616 Sep 27 16:48:46.123951 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 596/1141] 10.222.0.64 () {58 vars in 1413 bytes} [Tue Sep 27 16:48:46 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-volume_attachments/3e9a1de4-c2db-45ba-a810-4beb7b8a1aec => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:48:46.135629 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3a42f551-cea6-4676-8294-9d5674693eb3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:48:46.136206 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3a42f551-cea6-4676-8294-9d5674693eb3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:48:46.142806 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a42f551-cea6-4676-8294-9d5674693eb3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:46.143287 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a42f551-cea6-4676-8294-9d5674693eb3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:46.143755 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a42f551-cea6-4676-8294-9d5674693eb3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:46.144738 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a42f551-cea6-4676-8294-9d5674693eb3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:46.145202 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a42f551-cea6-4676-8294-9d5674693eb3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:46.145652 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a42f551-cea6-4676-8294-9d5674693eb3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:46.224475 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-3a42f551-cea6-4676-8294-9d5674693eb3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lazy-loading 'services' on Instance uuid 56ed9350-a296-4795-959a-ce50eafb5813 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:48:46.434395 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3a42f551-cea6-4676-8294-9d5674693eb3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "DELETE /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-volume_attachments/3e9a1de4-c2db-45ba-a810-4beb7b8a1aec" status: 202 len: 0 microversion: 2.1 time: 0.303556 Sep 27 16:48:46.435053 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 546/1142] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Sep 27 16:48:46 2022] DELETE /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-volume_attachments/3e9a1de4-c2db-45ba-a810-4beb7b8a1aec => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:48:47.612752 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8f233fcc-7f22-4c75-8415-c6193d72ee7c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:48:47.615022 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8f233fcc-7f22-4c75-8415-c6193d72ee7c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:48:47.621921 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f233fcc-7f22-4c75-8415-c6193d72ee7c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:47.622409 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f233fcc-7f22-4c75-8415-c6193d72ee7c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:47.622885 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f233fcc-7f22-4c75-8415-c6193d72ee7c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:47.623604 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f233fcc-7f22-4c75-8415-c6193d72ee7c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:47.624060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f233fcc-7f22-4c75-8415-c6193d72ee7c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:47.624486 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f233fcc-7f22-4c75-8415-c6193d72ee7c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:47.654004 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8f233fcc-7f22-4c75-8415-c6193d72ee7c tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045197 Sep 27 16:48:47.654556 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 597/1143] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Sep 27 16:48:47 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 16:48:47.767310 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-347491a1-4c5c-4d22-8d2d-d35e9055aca3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:48:47.769813 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-347491a1-4c5c-4d22-8d2d-d35e9055aca3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:48:47.776382 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-347491a1-4c5c-4d22-8d2d-d35e9055aca3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:47.776864 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-347491a1-4c5c-4d22-8d2d-d35e9055aca3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:47.777295 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-347491a1-4c5c-4d22-8d2d-d35e9055aca3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:47.777985 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-347491a1-4c5c-4d22-8d2d-d35e9055aca3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:47.778438 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-347491a1-4c5c-4d22-8d2d-d35e9055aca3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:47.778890 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-347491a1-4c5c-4d22-8d2d-d35e9055aca3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:47.808038 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-347491a1-4c5c-4d22-8d2d-d35e9055aca3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045022 Sep 27 16:48:47.808584 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 547/1144] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Sep 27 16:48:47 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 16:48:47.870808 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-36c9be47-4a44-49fe-acc2-156cbd91c2aa tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:48:47.871393 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-36c9be47-4a44-49fe-acc2-156cbd91c2aa tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:48:47.877319 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36c9be47-4a44-49fe-acc2-156cbd91c2aa tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:47.877809 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36c9be47-4a44-49fe-acc2-156cbd91c2aa tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:47.878247 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36c9be47-4a44-49fe-acc2-156cbd91c2aa tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:47.878977 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36c9be47-4a44-49fe-acc2-156cbd91c2aa tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:47.879437 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36c9be47-4a44-49fe-acc2-156cbd91c2aa tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:47.879865 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36c9be47-4a44-49fe-acc2-156cbd91c2aa tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:47.904357 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-36c9be47-4a44-49fe-acc2-156cbd91c2aa tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 16:48:48.225891 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-36c9be47-4a44-49fe-acc2-156cbd91c2aa tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "DELETE /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813" status: 204 len: 0 microversion: 2.1 time: 0.359413 Sep 27 16:48:48.227046 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 598/1145] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:48:47 2022] DELETE /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 16:48:48.235092 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-60b80a22-8053-4490-bb84-161a71664592 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:48:48.235708 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-60b80a22-8053-4490-bb84-161a71664592 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:48:48.242503 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60b80a22-8053-4490-bb84-161a71664592 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:48.243200 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60b80a22-8053-4490-bb84-161a71664592 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:48.243646 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60b80a22-8053-4490-bb84-161a71664592 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:48.244346 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60b80a22-8053-4490-bb84-161a71664592 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:48.244805 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60b80a22-8053-4490-bb84-161a71664592 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:48.245295 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60b80a22-8053-4490-bb84-161a71664592 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:48.376198 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-60b80a22-8053-4490-bb84-161a71664592 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:48:48.384232 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-60b80a22-8053-4490-bb84-161a71664592 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813" status: 200 len: 1673 microversion: 2.1 time: 0.153045 Sep 27 16:48:48.384817 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 548/1146] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:48:48 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:48:49.408670 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3ee638a6-2ce6-4879-9226-f25d59004b30 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:48:49.409380 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3ee638a6-2ce6-4879-9226-f25d59004b30 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:48:49.415910 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ee638a6-2ce6-4879-9226-f25d59004b30 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:49.416400 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ee638a6-2ce6-4879-9226-f25d59004b30 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:49.416842 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ee638a6-2ce6-4879-9226-f25d59004b30 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:49.417540 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ee638a6-2ce6-4879-9226-f25d59004b30 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:49.417998 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ee638a6-2ce6-4879-9226-f25d59004b30 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:49.418426 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3ee638a6-2ce6-4879-9226-f25d59004b30 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:49.547440 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3ee638a6-2ce6-4879-9226-f25d59004b30 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:48:49.556025 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3ee638a6-2ce6-4879-9226-f25d59004b30 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813" status: 200 len: 1673 microversion: 2.1 time: 0.151587 Sep 27 16:48:49.556606 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 599/1147] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:48:49 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:48:50.579649 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4f073892-f5c8-46cf-b8d9-602098307815 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:48:50.580260 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4f073892-f5c8-46cf-b8d9-602098307815 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:48:50.588042 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f073892-f5c8-46cf-b8d9-602098307815 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:50.588522 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f073892-f5c8-46cf-b8d9-602098307815 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:50.588952 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f073892-f5c8-46cf-b8d9-602098307815 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:50.589652 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f073892-f5c8-46cf-b8d9-602098307815 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:50.590104 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f073892-f5c8-46cf-b8d9-602098307815 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:50.590522 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f073892-f5c8-46cf-b8d9-602098307815 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:50.777195 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4f073892-f5c8-46cf-b8d9-602098307815 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:48:50.784995 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4f073892-f5c8-46cf-b8d9-602098307815 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813" status: 200 len: 1673 microversion: 2.1 time: 0.209296 Sep 27 16:48:50.785560 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 549/1148] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:48:50 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 => generated 1673 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:48:51.428788 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-ac7b1484-f198-4a33-a4ce-1d7e260e7576 req-0832e8a8-4e28-4f33-a368-7a3ec236e786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56ed9350-a296-4795-959a-ce50eafb5813", "name": "network-vif-deleted", "tag": "535083c1-2b25-4e68-97de-dca8c1b7f985"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:48:51.439509 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-ac7b1484-f198-4a33-a4ce-1d7e260e7576 req-0832e8a8-4e28-4f33-a368-7a3ec236e786 service nova] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:51.444425 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-ac7b1484-f198-4a33-a4ce-1d7e260e7576 req-0832e8a8-4e28-4f33-a368-7a3ec236e786 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:51.444425 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-ac7b1484-f198-4a33-a4ce-1d7e260e7576 req-0832e8a8-4e28-4f33-a368-7a3ec236e786 service nova] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:51.452265 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-ac7b1484-f198-4a33-a4ce-1d7e260e7576 req-0832e8a8-4e28-4f33-a368-7a3ec236e786 service nova] Creating event network-vif-deleted:535083c1-2b25-4e68-97de-dca8c1b7f985 for instance 56ed9350-a296-4795-959a-ce50eafb5813 on hv-cinder-85506 Sep 27 16:48:51.457382 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-ac7b1484-f198-4a33-a4ce-1d7e260e7576 req-0832e8a8-4e28-4f33-a368-7a3ec236e786 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032243 Sep 27 16:48:51.458159 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 600/1149] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Sep 27 16:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:48:51.816275 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0eff15f8-30b5-4037-a5ff-93c6cc6ed75e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:48:51.816835 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0eff15f8-30b5-4037-a5ff-93c6cc6ed75e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:48:51.824592 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0eff15f8-30b5-4037-a5ff-93c6cc6ed75e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:51.824592 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0eff15f8-30b5-4037-a5ff-93c6cc6ed75e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:51.824592 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0eff15f8-30b5-4037-a5ff-93c6cc6ed75e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:51.825290 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0eff15f8-30b5-4037-a5ff-93c6cc6ed75e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:51.825743 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0eff15f8-30b5-4037-a5ff-93c6cc6ed75e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:51.826167 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0eff15f8-30b5-4037-a5ff-93c6cc6ed75e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:51.859504 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0eff15f8-30b5-4037-a5ff-93c6cc6ed75e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:51.860001 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0eff15f8-30b5-4037-a5ff-93c6cc6ed75e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:51.863161 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0eff15f8-30b5-4037-a5ff-93c6cc6ed75e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:51.863161 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-0eff15f8-30b5-4037-a5ff-93c6cc6ed75e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lazy-loading 'fault' on Instance uuid 56ed9350-a296-4795-959a-ce50eafb5813 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 16:48:51.904490 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0eff15f8-30b5-4037-a5ff-93c6cc6ed75e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb0d1d7888436dae18a45598a8c82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a89110c26344f608dae59f5616575f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 16:48:51.912530 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0eff15f8-30b5-4037-a5ff-93c6cc6ed75e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813" status: 200 len: 1327 microversion: 2.1 time: 0.100488 Sep 27 16:48:51.913108 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 550/1150] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:48:51 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:48:52.941071 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1f8a5014-a0a1-4773-a91b-901c8cea88b3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:48:52.941763 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1f8a5014-a0a1-4773-a91b-901c8cea88b3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:48:52.948985 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f8a5014-a0a1-4773-a91b-901c8cea88b3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:52.949464 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f8a5014-a0a1-4773-a91b-901c8cea88b3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:52.949899 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f8a5014-a0a1-4773-a91b-901c8cea88b3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:52.950588 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f8a5014-a0a1-4773-a91b-901c8cea88b3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:52.951063 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f8a5014-a0a1-4773-a91b-901c8cea88b3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:52.951486 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f8a5014-a0a1-4773-a91b-901c8cea88b3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:52.964685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-1f8a5014-a0a1-4773-a91b-901c8cea88b3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] HTTP exception thrown: Instance 56ed9350-a296-4795-959a-ce50eafb5813 could not be found. Sep 27 16:48:52.966285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1f8a5014-a0a1-4773-a91b-901c8cea88b3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Request method failure captured: Sep 27 16:48:52.966285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 HTTP/1.1 Sep 27 16:48:52.966285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:48:52.966285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:48:52.966285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:48:52.966285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:48:52.966285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:48:52.966285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:48:52.966285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:48:52.966285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:48:52.966285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMyhe3ijCW-0eb711E_CbiCMZmKgskfwuv5H8R9ZZlytvg5HiDT0-muk6wyCzh_hXXzXcwtrtj6eqY-144ZgFsT67TZ3UixmaDeR5lsVOPFZPlKdeQjzjlgEU4d_JYgjDQQAuSWzFgNJui_6n0XWVZgSQavCPJuu4lRrWncLx09QeYpw Sep 27 16:48:52.966285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:48:52.966285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:48:52.966285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:48:52.966285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:48:52.966285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:48:52.966285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:48:52.966285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 0a89110c26344f608dae59f5616575f3 Sep 27 16:48:52.966285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeTestJSON-1890074404 Sep 27 16:48:52.966285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:48:52.966285 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:48:52.968088 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a89110c26344f608dae59f5616575f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0a89110c26344f608dae59f5616575f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0a89110c26344f608dae59f5616575f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a89110c26344f608dae59f5616575f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:48:52.968088 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeTestJSON-1890074404 Sep 27 16:48:52.968088 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 0a89110c26344f608dae59f5616575f3 Sep 27 16:48:52.968088 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1890074404 Sep 27 16:48:52.968088 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeTestJSON-1890074404-project Sep 27 16:48:52.968088 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:48:52.968088 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:48:52.968088 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: 09cb0d1d7888436dae18a45598a8c82a Sep 27 16:48:52.968088 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeTestJSON-1890074404-project Sep 27 16:48:52.968088 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:48:52.968088 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Instance 56ed9350-a296-4795-959a-ce50eafb5813 could not be found. Sep 27 16:48:52.968088 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': '56ed9350-a296-4795-959a-ce50eafb5813'} Sep 27 16:48:52.969092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:48:52.969092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:48:52.969092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:48:52.969092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:48:52.969092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:48:52.969092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:48:52.969092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:48:52.969092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:48:52.969092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:48:52.969092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:48:52.969092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56ed9350-a296-4795-959a-ce50eafb5813 could not be found. Sep 27 16:48:52.969092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:48:52.969092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:48:52.969092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:48:52.969092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:48:52.969092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:48:52.969092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:48:52.969092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:48:52.969092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:48:52.969092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:48:52.970767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:48:52.970767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:48:52.970767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:48:52.970767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:48:52.970767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:48:52.970767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:48:52.970767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:48:52.970767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56ed9350-a296-4795-959a-ce50eafb5813 could not be found. Sep 27 16:48:52.970767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:48:52.970767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:48:52.970767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:48:52.970767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:48:52.970767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:48:52.970767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:48:52.970767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:48:52.970767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:48:52.970767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56ed9350-a296-4795-959a-ce50eafb5813 could not be found. Sep 27 16:48:52.970767 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:48:52.972315 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1f8a5014-a0a1-4773-a91b-901c8cea88b3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Returning 404 to user: Instance 56ed9350-a296-4795-959a-ce50eafb5813 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:48:52.972315 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1f8a5014-a0a1-4773-a91b-901c8cea88b3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813" status: 404 len: 111 microversion: 2.1 time: 0.031562 Sep 27 16:48:52.972315 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 601/1151] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:48:52 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:48:52.977324 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-541145e2-30aa-4620-b99a-7332015c65bf tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '.version_select at 0x7fa405711ee0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:48:53.049790 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-541145e2-30aa-4620-b99a-7332015c65bf tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-653063763" status: 202 len: 0 microversion: 2.1 time: 0.077075 Sep 27 16:48:53.050398 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 551/1152] 10.222.0.64 () {58 vars in 1218 bytes} [Tue Sep 27 16:48:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-653063763 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 16:48:56.456781 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-235c8702-c551-4555-8fa8-07525283953e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:48:56.457263 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-235c8702-c551-4555-8fa8-07525283953e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:48:56.464266 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-235c8702-c551-4555-8fa8-07525283953e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:56.464758 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-235c8702-c551-4555-8fa8-07525283953e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:56.465201 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-235c8702-c551-4555-8fa8-07525283953e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:56.465905 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-235c8702-c551-4555-8fa8-07525283953e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:56.466368 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-235c8702-c551-4555-8fa8-07525283953e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:56.466822 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-235c8702-c551-4555-8fa8-07525283953e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:56.480848 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-235c8702-c551-4555-8fa8-07525283953e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] HTTP exception thrown: Instance 56ed9350-a296-4795-959a-ce50eafb5813 could not be found. Sep 27 16:48:56.482383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-235c8702-c551-4555-8fa8-07525283953e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Request method failure captured: Sep 27 16:48:56.482383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: DELETE /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 HTTP/1.1 Sep 27 16:48:56.482383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:48:56.482383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:48:56.482383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:48:56.482383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:48:56.482383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:48:56.482383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:48:56.482383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:48:56.482383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:48:56.482383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMyhe3ijCW-0eb711E_CbiCMZmKgskfwuv5H8R9ZZlytvg5HiDT0-muk6wyCzh_hXXzXcwtrtj6eqY-144ZgFsT67TZ3UixmaDeR5lsVOPFZPlKdeQjzjlgEU4d_JYgjDQQAuSWzFgNJui_6n0XWVZgSQavCPJuu4lRrWncLx09QeYpw Sep 27 16:48:56.482383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:48:56.482383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:48:56.482383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:48:56.482383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:48:56.482383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:48:56.482383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:48:56.482383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 0a89110c26344f608dae59f5616575f3 Sep 27 16:48:56.482383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeTestJSON-1890074404 Sep 27 16:48:56.482383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:48:56.482383 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:48:56.484050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a89110c26344f608dae59f5616575f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0a89110c26344f608dae59f5616575f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0a89110c26344f608dae59f5616575f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a89110c26344f608dae59f5616575f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:48:56.484050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeTestJSON-1890074404 Sep 27 16:48:56.484050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 0a89110c26344f608dae59f5616575f3 Sep 27 16:48:56.484050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1890074404 Sep 27 16:48:56.484050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeTestJSON-1890074404-project Sep 27 16:48:56.484050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:48:56.484050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:48:56.484050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: 09cb0d1d7888436dae18a45598a8c82a Sep 27 16:48:56.484050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeTestJSON-1890074404-project Sep 27 16:48:56.484050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:48:56.484050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Instance 56ed9350-a296-4795-959a-ce50eafb5813 could not be found. Sep 27 16:48:56.484050 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': '56ed9350-a296-4795-959a-ce50eafb5813'} Sep 27 16:48:56.485060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:48:56.485060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:48:56.485060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:48:56.485060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:48:56.485060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:48:56.485060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:48:56.485060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:48:56.485060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:48:56.485060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:48:56.485060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:48:56.485060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56ed9350-a296-4795-959a-ce50eafb5813 could not be found. Sep 27 16:48:56.485060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:48:56.485060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:48:56.485060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:48:56.485060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:48:56.485060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:48:56.485060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:48:56.485060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:48:56.485060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:48:56.485060 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:48:56.486682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:48:56.486682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 16:48:56.486682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 16:48:56.486682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 16:48:56.486682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 16:48:56.486682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:48:56.486682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:48:56.486682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:48:56.486682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:48:56.486682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56ed9350-a296-4795-959a-ce50eafb5813 could not be found. Sep 27 16:48:56.486682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:48:56.486682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:48:56.486682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:48:56.486682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:48:56.486682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:48:56.486682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:48:56.486682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:48:56.486682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:48:56.486682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56ed9350-a296-4795-959a-ce50eafb5813 could not be found. Sep 27 16:48:56.486682 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:48:56.488465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-235c8702-c551-4555-8fa8-07525283953e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Returning 404 to user: Instance 56ed9350-a296-4795-959a-ce50eafb5813 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:48:56.488465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-235c8702-c551-4555-8fa8-07525283953e tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "DELETE /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813" status: 404 len: 111 microversion: 2.1 time: 0.030900 Sep 27 16:48:56.488465 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 602/1153] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:48:56 2022] DELETE /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:48:56.492669 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3b7358b5-1e5a-40f8-99c8-532d8d4a17d9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:48:56.493308 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3b7358b5-1e5a-40f8-99c8-532d8d4a17d9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 56ed9350-a296-4795-959a-ce50eafb5813] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:48:56.499834 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b7358b5-1e5a-40f8-99c8-532d8d4a17d9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:56.500322 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b7358b5-1e5a-40f8-99c8-532d8d4a17d9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:56.500761 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b7358b5-1e5a-40f8-99c8-532d8d4a17d9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:56.501455 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b7358b5-1e5a-40f8-99c8-532d8d4a17d9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:56.501915 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b7358b5-1e5a-40f8-99c8-532d8d4a17d9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:56.502342 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3b7358b5-1e5a-40f8-99c8-532d8d4a17d9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:56.515700 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-3b7358b5-1e5a-40f8-99c8-532d8d4a17d9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] HTTP exception thrown: Instance 56ed9350-a296-4795-959a-ce50eafb5813 could not be found. Sep 27 16:48:56.517348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3b7358b5-1e5a-40f8-99c8-532d8d4a17d9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Request method failure captured: Sep 27 16:48:56.517348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 HTTP/1.1 Sep 27 16:48:56.517348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:48:56.517348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:48:56.517348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:48:56.517348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 27 16:48:56.517348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:48:56.517348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:48:56.517348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:48:56.517348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:48:56.517348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMyhe3ijCW-0eb711E_CbiCMZmKgskfwuv5H8R9ZZlytvg5HiDT0-muk6wyCzh_hXXzXcwtrtj6eqY-144ZgFsT67TZ3UixmaDeR5lsVOPFZPlKdeQjzjlgEU4d_JYgjDQQAuSWzFgNJui_6n0XWVZgSQavCPJuu4lRrWncLx09QeYpw Sep 27 16:48:56.517348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:48:56.517348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:48:56.517348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:48:56.517348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:48:56.517348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:48:56.517348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:48:56.517348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: 0a89110c26344f608dae59f5616575f3 Sep 27 16:48:56.517348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeTestJSON-1890074404 Sep 27 16:48:56.517348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:48:56.517348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:48:56.519338 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a89110c26344f608dae59f5616575f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0a89110c26344f608dae59f5616575f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0a89110c26344f608dae59f5616575f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a89110c26344f608dae59f5616575f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:48:56.519338 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeTestJSON-1890074404 Sep 27 16:48:56.519338 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 0a89110c26344f608dae59f5616575f3 Sep 27 16:48:56.519338 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1890074404 Sep 27 16:48:56.519338 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeTestJSON-1890074404-project Sep 27 16:48:56.519338 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:48:56.519338 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:48:56.519338 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: 09cb0d1d7888436dae18a45598a8c82a Sep 27 16:48:56.519338 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeTestJSON-1890074404-project Sep 27 16:48:56.519338 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: > Sep 27 16:48:56.519338 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Instance 56ed9350-a296-4795-959a-ce50eafb5813 could not be found. Sep 27 16:48:56.519338 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'id': '56ed9350-a296-4795-959a-ce50eafb5813'} Sep 27 16:48:56.520394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:48:56.520394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:48:56.520394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:48:56.520394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:48:56.520394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:48:56.520394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:48:56.520394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:48:56.520394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:48:56.520394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:48:56.520394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:48:56.520394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56ed9350-a296-4795-959a-ce50eafb5813 could not be found. Sep 27 16:48:56.520394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:48:56.520394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:48:56.520394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:48:56.520394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:48:56.520394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:48:56.520394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:48:56.520394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:48:56.520394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:48:56.520394 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:48:56.521964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:48:56.521964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:48:56.521964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:48:56.521964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:48:56.521964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:48:56.521964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:48:56.521964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:48:56.521964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56ed9350-a296-4795-959a-ce50eafb5813 could not be found. Sep 27 16:48:56.521964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:48:56.521964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:48:56.521964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:48:56.521964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:48:56.521964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:48:56.521964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:48:56.521964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:48:56.521964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:48:56.521964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56ed9350-a296-4795-959a-ce50eafb5813 could not be found. Sep 27 16:48:56.521964 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:48:56.523464 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3b7358b5-1e5a-40f8-99c8-532d8d4a17d9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Returning 404 to user: Instance 56ed9350-a296-4795-959a-ce50eafb5813 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:48:56.523464 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3b7358b5-1e5a-40f8-99c8-532d8d4a17d9 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813" status: 404 len: 111 microversion: 2.1 time: 0.030615 Sep 27 16:48:56.523464 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 552/1154] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:48:56 2022] GET /compute/v2.1/servers/56ed9350-a296-4795-959a-ce50eafb5813 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:48:57.822584 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ecc1ae72-9da6-4aaa-b338-3145c75092f3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:48:57.823129 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ecc1ae72-9da6-4aaa-b338-3145c75092f3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:48:57.829469 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecc1ae72-9da6-4aaa-b338-3145c75092f3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:57.829954 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecc1ae72-9da6-4aaa-b338-3145c75092f3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:57.830392 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecc1ae72-9da6-4aaa-b338-3145c75092f3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:57.831123 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecc1ae72-9da6-4aaa-b338-3145c75092f3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:57.831581 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecc1ae72-9da6-4aaa-b338-3145c75092f3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:57.832008 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ecc1ae72-9da6-4aaa-b338-3145c75092f3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:57.846038 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-ecc1ae72-9da6-4aaa-b338-3145c75092f3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] HTTP exception thrown: Instance 23412d14-1e6d-4792-b23b-591d19c2bd7e could not be found. Sep 27 16:48:57.847603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ecc1ae72-9da6-4aaa-b338-3145c75092f3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Request method failure captured: Sep 27 16:48:57.847603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: DELETE /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e HTTP/1.1 Sep 27 16:48:57.847603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:48:57.847603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:48:57.847603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:48:57.847603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:48:57.847603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:48:57.847603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:48:57.847603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:48:57.847603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:48:57.847603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMyhe3ijCW-0eb711E_CbiCMZmKgskfwuv5H8R9ZZlytvg5HiDT0-muk6wyCzh_hXXzXcwtrtj6eqY-144ZgFsT67TZ3UixmaDeR5lsVOPFZPlKdeQjzjlgEU4d_JYgjDQQAuSWzFgNJui_6n0XWVZgSQavCPJuu4lRrWncLx09QeYpw Sep 27 16:48:57.847603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:48:57.847603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:48:57.847603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:48:57.847603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:48:57.847603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:48:57.847603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:48:57.847603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 0a89110c26344f608dae59f5616575f3 Sep 27 16:48:57.847603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeTestJSON-1890074404 Sep 27 16:48:57.847603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:48:57.847603 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:48:57.849356 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a89110c26344f608dae59f5616575f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0a89110c26344f608dae59f5616575f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0a89110c26344f608dae59f5616575f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a89110c26344f608dae59f5616575f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:48:57.849356 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeTestJSON-1890074404 Sep 27 16:48:57.849356 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 0a89110c26344f608dae59f5616575f3 Sep 27 16:48:57.849356 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1890074404 Sep 27 16:48:57.849356 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeTestJSON-1890074404-project Sep 27 16:48:57.849356 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:48:57.849356 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:48:57.849356 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: 09cb0d1d7888436dae18a45598a8c82a Sep 27 16:48:57.849356 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeTestJSON-1890074404-project Sep 27 16:48:57.849356 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: > Sep 27 16:48:57.849356 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Instance 23412d14-1e6d-4792-b23b-591d19c2bd7e could not be found. Sep 27 16:48:57.849356 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': '23412d14-1e6d-4792-b23b-591d19c2bd7e'} Sep 27 16:48:57.850303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:48:57.850303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:48:57.850303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:48:57.850303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:48:57.850303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:48:57.850303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:48:57.850303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:48:57.850303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:48:57.850303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:48:57.850303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:48:57.850303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23412d14-1e6d-4792-b23b-591d19c2bd7e could not be found. Sep 27 16:48:57.850303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:48:57.850303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:48:57.850303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:48:57.850303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:48:57.850303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:48:57.850303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:48:57.850303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:48:57.850303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:48:57.850303 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:48:57.851886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:48:57.851886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 16:48:57.851886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 16:48:57.851886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 16:48:57.851886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 16:48:57.851886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:48:57.851886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:48:57.851886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:48:57.851886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:48:57.851886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23412d14-1e6d-4792-b23b-591d19c2bd7e could not be found. Sep 27 16:48:57.851886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:48:57.851886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:48:57.851886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:48:57.851886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:48:57.851886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:48:57.851886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:48:57.851886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:48:57.851886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:48:57.851886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23412d14-1e6d-4792-b23b-591d19c2bd7e could not be found. Sep 27 16:48:57.851886 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:48:57.854122 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ecc1ae72-9da6-4aaa-b338-3145c75092f3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Returning 404 to user: Instance 23412d14-1e6d-4792-b23b-591d19c2bd7e could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:48:57.854122 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ecc1ae72-9da6-4aaa-b338-3145c75092f3 tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "DELETE /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 404 len: 111 microversion: 2.1 time: 0.030420 Sep 27 16:48:57.854122 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 603/1155] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Sep 27 16:48:57 2022] DELETE /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:48:57.858167 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a456868a-2d14-4286-842e-15fe73ec8f8d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:48:57.858841 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a456868a-2d14-4286-842e-15fe73ec8f8d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] [instance: 23412d14-1e6d-4792-b23b-591d19c2bd7e] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 16:48:57.865269 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a456868a-2d14-4286-842e-15fe73ec8f8d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:57.865753 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a456868a-2d14-4286-842e-15fe73ec8f8d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:57.866192 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a456868a-2d14-4286-842e-15fe73ec8f8d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:57.866922 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a456868a-2d14-4286-842e-15fe73ec8f8d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Acquiring lock "0c749112-4e30-414e-83db-5e002ec73710" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 16:48:57.867383 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a456868a-2d14-4286-842e-15fe73ec8f8d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 16:48:57.867811 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a456868a-2d14-4286-842e-15fe73ec8f8d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Lock "0c749112-4e30-414e-83db-5e002ec73710" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 16:48:57.883007 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-a456868a-2d14-4286-842e-15fe73ec8f8d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] HTTP exception thrown: Instance 23412d14-1e6d-4792-b23b-591d19c2bd7e could not be found. Sep 27 16:48:57.884661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a456868a-2d14-4286-842e-15fe73ec8f8d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Request method failure captured: Sep 27 16:48:57.884661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e HTTP/1.1 Sep 27 16:48:57.884661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:48:57.884661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:48:57.884661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:48:57.884661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 27 16:48:57.884661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:48:57.884661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:48:57.884661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:48:57.884661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:48:57.884661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMyhe3ijCW-0eb711E_CbiCMZmKgskfwuv5H8R9ZZlytvg5HiDT0-muk6wyCzh_hXXzXcwtrtj6eqY-144ZgFsT67TZ3UixmaDeR5lsVOPFZPlKdeQjzjlgEU4d_JYgjDQQAuSWzFgNJui_6n0XWVZgSQavCPJuu4lRrWncLx09QeYpw Sep 27 16:48:57.884661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:48:57.884661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:48:57.884661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:48:57.884661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:48:57.884661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:48:57.884661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:48:57.884661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: 0a89110c26344f608dae59f5616575f3 Sep 27 16:48:57.884661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeTestJSON-1890074404 Sep 27 16:48:57.884661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:48:57.884661 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:48:57.892430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a89110c26344f608dae59f5616575f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0a89110c26344f608dae59f5616575f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0a89110c26344f608dae59f5616575f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a89110c26344f608dae59f5616575f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:48:57.892430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeTestJSON-1890074404 Sep 27 16:48:57.892430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 0a89110c26344f608dae59f5616575f3 Sep 27 16:48:57.892430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1890074404 Sep 27 16:48:57.892430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeTestJSON-1890074404-project Sep 27 16:48:57.892430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:48:57.892430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:48:57.892430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: 09cb0d1d7888436dae18a45598a8c82a Sep 27 16:48:57.892430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeTestJSON-1890074404-project Sep 27 16:48:57.892430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: > Sep 27 16:48:57.892430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Instance 23412d14-1e6d-4792-b23b-591d19c2bd7e could not be found. Sep 27 16:48:57.892430 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'id': '23412d14-1e6d-4792-b23b-591d19c2bd7e'} Sep 27 16:48:57.893356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:48:57.893356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:48:57.893356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 16:48:57.893356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 16:48:57.893356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 16:48:57.893356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 16:48:57.893356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 16:48:57.893356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 16:48:57.893356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 16:48:57.893356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 16:48:57.893356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23412d14-1e6d-4792-b23b-591d19c2bd7e could not be found. Sep 27 16:48:57.893356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:48:57.893356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:48:57.893356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:48:57.893356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:48:57.893356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:48:57.893356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:48:57.893356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:48:57.893356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:48:57.893356 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:48:57.895205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:48:57.895205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 16:48:57.895205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 16:48:57.895205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 16:48:57.895205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 16:48:57.895205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 16:48:57.895205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:48:57.895205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23412d14-1e6d-4792-b23b-591d19c2bd7e could not be found. Sep 27 16:48:57.895205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:48:57.895205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:48:57.895205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:48:57.895205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:48:57.895205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:48:57.895205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:48:57.895205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:48:57.895205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:48:57.895205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23412d14-1e6d-4792-b23b-591d19c2bd7e could not be found. Sep 27 16:48:57.895205 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:48:57.897185 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a456868a-2d14-4286-842e-15fe73ec8f8d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] Returning 404 to user: Instance 23412d14-1e6d-4792-b23b-591d19c2bd7e could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:48:57.897185 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a456868a-2d14-4286-842e-15fe73ec8f8d tempest-AttachVolumeTestJSON-1890074404 tempest-AttachVolumeTestJSON-1890074404-project] 10.222.0.64 "GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e" status: 404 len: 111 microversion: 2.1 time: 0.031772 Sep 27 16:48:57.897185 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 553/1156] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Sep 27 16:48:57 2022] GET /compute/v2.1/servers/23412d14-1e6d-4792-b23b-591d19c2bd7e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:49:04.980108 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5603bb11-dac0-4886-83fe-66b235aa3a65 tempest-VolumesTestJSON-954366720 tempest-VolumesTestJSON-954366720-project] Calling method '.version_select at 0x7fa405c998b0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:49:05.026764 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5603bb11-dac0-4886-83fe-66b235aa3a65 tempest-VolumesTestJSON-954366720 tempest-VolumesTestJSON-954366720-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/3f97b1d8-b7b1-4f88-92e0-44078fe52e3b" status: 200 len: 349 microversion: 2.1 time: 0.051226 Sep 27 16:49:05.027380 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 604/1157] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Sep 27 16:49:04 2022] GET /compute/v2.1/os-volumes/3f97b1d8-b7b1-4f88-92e0-44078fe52e3b => generated 349 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:49:06.586577 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4feecf14-69e4-4128-b389-410d012ea489 tempest-VolumesTestJSON-954366720 tempest-VolumesTestJSON-954366720-project] Calling method '.version_select at 0x7fa405735af0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:49:06.634641 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4feecf14-69e4-4128-b389-410d012ea489 tempest-VolumesTestJSON-954366720 tempest-VolumesTestJSON-954366720-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/064e9601-f8ba-4a01-a23e-a35236c845bb" status: 200 len: 350 microversion: 2.1 time: 0.051831 Sep 27 16:49:06.635318 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 554/1158] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Sep 27 16:49:06 2022] GET /compute/v2.1/os-volumes/064e9601-f8ba-4a01-a23e-a35236c845bb => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:49:08.359784 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:49:08.360663 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:49:08.364512 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9ecb1a8a-15bc-4fe8-8fd3-fdd312472dfc tempest-VolumesTestJSON-954366720 tempest-VolumesTestJSON-954366720-project] Calling method '.version_select at 0x7fa4090c3820>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:49:08.411294 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9ecb1a8a-15bc-4fe8-8fd3-fdd312472dfc tempest-VolumesTestJSON-954366720 tempest-VolumesTestJSON-954366720-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/3d6bcc13-9775-4fee-8b94-591c94d3f7f6" status: 200 len: 350 microversion: 2.1 time: 0.053806 Sep 27 16:49:08.411971 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 605/1159] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Sep 27 16:49:08 2022] GET /compute/v2.1/os-volumes/3d6bcc13-9775-4fee-8b94-591c94d3f7f6 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:49:08.422996 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:49:08.423850 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 16:49:08.427626 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0ced8a5a-7494-44ee-ab52-3e5a38959a12 tempest-VolumesTestJSON-954366720 tempest-VolumesTestJSON-954366720-project] Calling method '.version_select at 0x7fa4055e71f0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:49:08.507796 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0ced8a5a-7494-44ee-ab52-3e5a38959a12 tempest-VolumesTestJSON-954366720 tempest-VolumesTestJSON-954366720-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.086041 Sep 27 16:49:08.508390 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 555/1160] 10.222.0.64 () {58 vars in 1134 bytes} [Tue Sep 27 16:49:08 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 16:49:08.523307 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3c08b7e6-7df1-4aa9-8977-0afaf24c2621 tempest-VolumesTestJSON-954366720 tempest-VolumesTestJSON-954366720-project] Calling method '.version_select at 0x7fa406669310>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:49:08.605520 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3c08b7e6-7df1-4aa9-8977-0afaf24c2621 tempest-VolumesTestJSON-954366720 tempest-VolumesTestJSON-954366720-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.086858 Sep 27 16:49:08.606084 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 606/1161] 10.222.0.64 () {58 vars in 1149 bytes} [Tue Sep 27 16:49:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:49:08.619758 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-15cfb2cc-dca4-4862-8201-3665c2ee92fa tempest-VolumesTestJSON-954366720 tempest-VolumesTestJSON-954366720-project] Calling method '.version_select at 0x7fa4055e7940>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:49:08.701366 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-15cfb2cc-dca4-4862-8201-3665c2ee92fa tempest-VolumesTestJSON-954366720 tempest-VolumesTestJSON-954366720-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.084848 Sep 27 16:49:08.701940 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 556/1162] 10.222.0.64 () {58 vars in 1134 bytes} [Tue Sep 27 16:49:08 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:49:08.714949 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c5c8b856-9200-4230-8ac4-58a7c9b9aa21 tempest-VolumesTestJSON-954366720 tempest-VolumesTestJSON-954366720-project] Calling method '.version_select at 0x7fa4090c3b80>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:49:08.795488 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c5c8b856-9200-4230-8ac4-58a7c9b9aa21 tempest-VolumesTestJSON-954366720 tempest-VolumesTestJSON-954366720-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084288 Sep 27 16:49:08.796052 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 607/1163] 10.222.0.64 () {58 vars in 1167 bytes} [Tue Sep 27 16:49:08 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:49:08.809348 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c9fa0e4e-e293-4cc6-9e7a-39c5bcf0024f tempest-VolumesTestJSON-954366720 tempest-VolumesTestJSON-954366720-project] Calling method '.version_select at 0x7fa4057e1f70>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:49:08.894526 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c9fa0e4e-e293-4cc6-9e7a-39c5bcf0024f tempest-VolumesTestJSON-954366720 tempest-VolumesTestJSON-954366720-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.088819 Sep 27 16:49:08.895135 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 557/1164] 10.222.0.64 () {58 vars in 1170 bytes} [Tue Sep 27 16:49:08 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:49:08.909885 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9e9bdaf0-4731-48c1-9a7f-0a7d22ca43df tempest-VolumesTestJSON-954366720 tempest-VolumesTestJSON-954366720-project] Calling method '.version_select at 0x7fa405a295e0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:49:08.992900 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9e9bdaf0-4731-48c1-9a7f-0a7d22ca43df tempest-VolumesTestJSON-954366720 tempest-VolumesTestJSON-954366720-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.086807 Sep 27 16:49:08.993470 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 608/1165] 10.222.0.64 () {58 vars in 1155 bytes} [Tue Sep 27 16:49:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:49:09.007421 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-645ebdaf-1c45-4eda-9ed5-0c8c14b7cff4 tempest-VolumesTestJSON-954366720 tempest-VolumesTestJSON-954366720-project] Calling method '.version_select at 0x7fa405711ee0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:49:09.087986 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-645ebdaf-1c45-4eda-9ed5-0c8c14b7cff4 tempest-VolumesTestJSON-954366720 tempest-VolumesTestJSON-954366720-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084271 Sep 27 16:49:09.088551 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 558/1166] 10.222.0.64 () {58 vars in 1188 bytes} [Tue Sep 27 16:49:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 16:49:09.102588 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7479a6d1-6658-4ea0-a18e-c4ce21a75630 tempest-VolumesTestJSON-954366720 tempest-VolumesTestJSON-954366720-project] Calling method '.version_select at 0x7fa4059dde50>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:49:09.190674 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7479a6d1-6658-4ea0-a18e-c4ce21a75630 tempest-VolumesTestJSON-954366720 tempest-VolumesTestJSON-954366720-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.091897 Sep 27 16:49:09.191492 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 609/1167] 10.222.0.64 () {58 vars in 1155 bytes} [Tue Sep 27 16:49:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 16:49:15.085257 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-da5bdd84-26e2-447c-a75c-6050c8c379c4 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] Action: 'create', calling method: .version_select at 0x7fa4057481f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-63354927", "metadata": {"Type": "work"}}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:49:15.101343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-da5bdd84-26e2-447c-a75c-6050c8c379c4 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] Request method failure captured: Sep 27 16:49:15.101343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 27 16:49:15.101343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:49:15.101343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:49:15.101343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:49:15.101343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 120 Sep 27 16:49:15.101343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:49:15.101343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:49:15.101343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:49:15.101343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:49:15.101343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMymKscf7Cu5l5YzUkxEzz00gLxTLWrpDcEqW-RoyfMuq-GLq2ZnzCgr3F1T4tVAs7Yx_LTotopU-OE_Ijw5hPglhvN_9VF2ucKuYLFpdeHIPgZvAGKhXD_9uQpXZyLn9I9a-gxME5jkamGZihz-tf3gVfJRKFOSyq7-zJ0-JFW-TruI Sep 27 16:49:15.101343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:49:15.101343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:49:15.101343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:49:15.101343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:49:15.101343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:49:15.101343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:49:15.101343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: 55b3f15fb2714f2cb893a0f4430d9bac Sep 27 16:49:15.101343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesNegativeTest-863838489 Sep 27 16:49:15.101343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:49:15.101343 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:49:15.103088 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:49:15.103088 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesNegativeTest-863838489 Sep 27 16:49:15.103088 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 55b3f15fb2714f2cb893a0f4430d9bac Sep 27 16:49:15.103088 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesNegativeTest-863838489 Sep 27 16:49:15.103088 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesNegativeTest-863838489-project Sep 27 16:49:15.103088 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:49:15.103088 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:49:15.103088 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: 0eb34e423bd84c8e808a61e8483a68b7 Sep 27 16:49:15.103088 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesNegativeTest-863838489-project Sep 27 16:49:15.103088 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Sep 27 16:49:15.103088 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-63354927", "metadata": {"Type": "work"}}} Sep 27 16:49:15.103088 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: Sep 27 16:49:15.103088 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 27 16:49:15.104301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-63354927', 'metadata': {'Type': 'work'}}}} Sep 27 16:49:15.104301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:49:15.104301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:49:15.104301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 16:49:15.104301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 16:49:15.104301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 16:49:15.104301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise error Sep 27 16:49:15.104301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 27 16:49:15.104301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.104301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 27 16:49:15.104301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 27 16:49:15.104301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.104301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 27 16:49:15.104301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi '#$%' Sep 27 16:49:15.104301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.104301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:49:15.104301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.104301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:49:15.104301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:49:15.104301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:49:15.104301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:49:15.104301 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:49:15.105899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 16:49:15.105899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 16:49:15.105899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:49:15.105899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:49:15.105899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 16:49:15.105899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 16:49:15.105899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 16:49:15.105899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 16:49:15.105899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 16:49:15.105899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 16:49:15.105899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 27 16:49:15.105899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.105899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:49:15.105899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.105899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:49:15.105899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:49:15.105899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:49:15.105899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 16:49:15.105899 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 16:49:15.107673 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 27 16:49:15.107673 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.107673 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-da5bdd84-26e2-447c-a75c-6050c8c379c4 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:49:15.107673 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-da5bdd84-26e2-447c-a75c-6050c8c379c4 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.134115 Sep 27 16:49:15.107673 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 559/1168] 10.222.0.64 () {60 vars in 1156 bytes} [Tue Sep 27 16:49:14 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 16:49:15.113305 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-45f29756-acd8-4e50-8165-67abb47d9aa9 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] Action: 'create', calling method: .version_select at 0x7fa4090c3430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1255262757", "metadata": {"Type": "work"}}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:49:15.117810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-45f29756-acd8-4e50-8165-67abb47d9aa9 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] Request method failure captured: Sep 27 16:49:15.117810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 27 16:49:15.117810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:49:15.117810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:49:15.117810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:49:15.117810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 120 Sep 27 16:49:15.117810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:49:15.117810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:49:15.117810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:49:15.117810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:49:15.117810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMymKscf7Cu5l5YzUkxEzz00gLxTLWrpDcEqW-RoyfMuq-GLq2ZnzCgr3F1T4tVAs7Yx_LTotopU-OE_Ijw5hPglhvN_9VF2ucKuYLFpdeHIPgZvAGKhXD_9uQpXZyLn9I9a-gxME5jkamGZihz-tf3gVfJRKFOSyq7-zJ0-JFW-TruI Sep 27 16:49:15.117810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:49:15.117810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:49:15.117810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:49:15.117810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:49:15.117810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:49:15.117810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:49:15.117810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 55b3f15fb2714f2cb893a0f4430d9bac Sep 27 16:49:15.117810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesNegativeTest-863838489 Sep 27 16:49:15.117810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:49:15.117810 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:49:15.119632 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:49:15.119632 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesNegativeTest-863838489 Sep 27 16:49:15.119632 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 55b3f15fb2714f2cb893a0f4430d9bac Sep 27 16:49:15.119632 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesNegativeTest-863838489 Sep 27 16:49:15.119632 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesNegativeTest-863838489-project Sep 27 16:49:15.119632 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:49:15.119632 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:49:15.119632 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: 0eb34e423bd84c8e808a61e8483a68b7 Sep 27 16:49:15.119632 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesNegativeTest-863838489-project Sep 27 16:49:15.119632 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Sep 27 16:49:15.119632 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1255262757", "metadata": {"Type": "work"}}} Sep 27 16:49:15.119632 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: Sep 27 16:49:15.119632 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 27 16:49:15.120690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1255262757', 'metadata': {'Type': 'work'}}}} Sep 27 16:49:15.120690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:49:15.120690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:49:15.120690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 16:49:15.120690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 16:49:15.120690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 16:49:15.120690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise error Sep 27 16:49:15.120690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 27 16:49:15.120690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.120690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 27 16:49:15.120690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 27 16:49:15.120690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.120690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 27 16:49:15.120690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi '0' Sep 27 16:49:15.120690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.120690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:49:15.120690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.120690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:49:15.120690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:49:15.120690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:49:15.120690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:49:15.120690 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:49:15.122185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 16:49:15.122185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 16:49:15.122185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:49:15.122185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:49:15.122185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 16:49:15.122185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 16:49:15.122185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 16:49:15.122185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 16:49:15.122185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 16:49:15.122185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 16:49:15.122185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 27 16:49:15.122185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.122185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:49:15.122185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.122185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:49:15.122185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:49:15.122185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:49:15.122185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 16:49:15.122185 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 16:49:15.124370 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 27 16:49:15.124370 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.124370 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-45f29756-acd8-4e50-8165-67abb47d9aa9 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:49:15.124370 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-45f29756-acd8-4e50-8165-67abb47d9aa9 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010193 Sep 27 16:49:15.124370 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 610/1169] 10.222.0.64 () {60 vars in 1156 bytes} [Tue Sep 27 16:49:15 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 16:49:15.129199 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-087b9ea2-40ab-4990-b6d7-ac45a7c3caba tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] Action: 'create', calling method: .version_select at 0x7fa405c41430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-642597625", "metadata": {"Type": "work"}}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 16:49:15.132729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-087b9ea2-40ab-4990-b6d7-ac45a7c3caba tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] Request method failure captured: Sep 27 16:49:15.132729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 27 16:49:15.132729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:49:15.132729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:49:15.132729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:49:15.132729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 118 Sep 27 16:49:15.132729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:49:15.132729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:49:15.132729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:49:15.132729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:49:15.132729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMymKscf7Cu5l5YzUkxEzz00gLxTLWrpDcEqW-RoyfMuq-GLq2ZnzCgr3F1T4tVAs7Yx_LTotopU-OE_Ijw5hPglhvN_9VF2ucKuYLFpdeHIPgZvAGKhXD_9uQpXZyLn9I9a-gxME5jkamGZihz-tf3gVfJRKFOSyq7-zJ0-JFW-TruI Sep 27 16:49:15.132729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:49:15.132729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:49:15.132729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:49:15.132729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:49:15.132729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:49:15.132729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:49:15.132729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: 55b3f15fb2714f2cb893a0f4430d9bac Sep 27 16:49:15.132729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesNegativeTest-863838489 Sep 27 16:49:15.132729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:49:15.132729 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:49:15.134413 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:49:15.134413 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesNegativeTest-863838489 Sep 27 16:49:15.134413 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 55b3f15fb2714f2cb893a0f4430d9bac Sep 27 16:49:15.134413 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesNegativeTest-863838489 Sep 27 16:49:15.134413 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesNegativeTest-863838489-project Sep 27 16:49:15.134413 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:49:15.134413 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:49:15.134413 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: 0eb34e423bd84c8e808a61e8483a68b7 Sep 27 16:49:15.134413 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesNegativeTest-863838489-project Sep 27 16:49:15.134413 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Sep 27 16:49:15.134413 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-642597625", "metadata": {"Type": "work"}}} Sep 27 16:49:15.134413 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: Sep 27 16:49:15.134413 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 27 16:49:15.135548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-642597625', 'metadata': {'Type': 'work'}}}} Sep 27 16:49:15.135548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:49:15.135548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:49:15.135548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 16:49:15.135548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 16:49:15.135548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 16:49:15.135548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise error Sep 27 16:49:15.135548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 27 16:49:15.135548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.135548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 27 16:49:15.135548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 27 16:49:15.135548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.135548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 27 16:49:15.135548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi '' Sep 27 16:49:15.135548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.135548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:49:15.135548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.135548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:49:15.135548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:49:15.135548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:49:15.135548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:49:15.135548 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:49:15.137332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 16:49:15.137332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 16:49:15.137332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:49:15.137332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:49:15.137332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 16:49:15.137332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 16:49:15.137332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 16:49:15.137332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 16:49:15.137332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 16:49:15.137332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 16:49:15.137332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 27 16:49:15.137332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.137332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:49:15.137332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.137332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:49:15.137332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:49:15.137332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:49:15.137332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 16:49:15.137332 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 16:49:15.140153 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 27 16:49:15.140153 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.140153 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-087b9ea2-40ab-4990-b6d7-ac45a7c3caba tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:49:15.140153 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-087b9ea2-40ab-4990-b6d7-ac45a7c3caba tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008632 Sep 27 16:49:15.140153 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 560/1170] 10.222.0.64 () {60 vars in 1156 bytes} [Tue Sep 27 16:49:15 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 16:49:15.144033 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7aaa77c7-7dea-450b-b4e8-425670756dd4 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] Calling method '.version_select at 0x7fa40590b940>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:49:15.172413 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-7aaa77c7-7dea-450b-b4e8-425670756dd4 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] HTTP exception thrown: Volume tempest-invalid-520800244 could not be found. Sep 27 16:49:15.174447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7aaa77c7-7dea-450b-b4e8-425670756dd4 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] Request method failure captured: Sep 27 16:49:15.174447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-520800244 HTTP/1.1 Sep 27 16:49:15.174447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:49:15.174447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:49:15.174447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:49:15.174447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:49:15.174447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:49:15.174447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:49:15.174447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:49:15.174447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:49:15.174447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMymKscf7Cu5l5YzUkxEzz00gLxTLWrpDcEqW-RoyfMuq-GLq2ZnzCgr3F1T4tVAs7Yx_LTotopU-OE_Ijw5hPglhvN_9VF2ucKuYLFpdeHIPgZvAGKhXD_9uQpXZyLn9I9a-gxME5jkamGZihz-tf3gVfJRKFOSyq7-zJ0-JFW-TruI Sep 27 16:49:15.174447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:49:15.174447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:49:15.174447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:49:15.174447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:49:15.174447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:49:15.174447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:49:15.174447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 55b3f15fb2714f2cb893a0f4430d9bac Sep 27 16:49:15.174447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesNegativeTest-863838489 Sep 27 16:49:15.174447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:49:15.174447 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:49:15.176075 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:49:15.176075 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesNegativeTest-863838489 Sep 27 16:49:15.176075 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 55b3f15fb2714f2cb893a0f4430d9bac Sep 27 16:49:15.176075 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesNegativeTest-863838489 Sep 27 16:49:15.176075 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesNegativeTest-863838489-project Sep 27 16:49:15.176075 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:49:15.176075 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:49:15.176075 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: 0eb34e423bd84c8e808a61e8483a68b7 Sep 27 16:49:15.176075 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesNegativeTest-863838489-project Sep 27 16:49:15.176075 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: Sep 27 16:49:15.176075 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Volume tempest-invalid-520800244 could not be found. Sep 27 16:49:15.176075 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': 'tempest-invalid-520800244'} Sep 27 16:49:15.176075 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:49:15.178884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:49:15.178884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 16:49:15.178884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 16:49:15.178884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 27 16:49:15.178884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 27 16:49:15.178884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 27 16:49:15.178884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 27 16:49:15.178884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 27 16:49:15.178884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 27 16:49:15.178884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 27 16:49:15.178884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 27 16:49:15.178884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 16:49:15.178884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 16:49:15.178884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 16:49:15.178884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 16:49:15.178884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-520800244 could not be found. (HTTP 404) (Request-ID: req-35f861be-5799-4c52-b4a0-1d27be82fbe5) Sep 27 16:49:15.178884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.178884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:49:15.178884 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.180441 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:49:15.180441 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 27 16:49:15.180441 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 27 16:49:15.180441 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 16:49:15.180441 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 16:49:15.180441 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 27 16:49:15.180441 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 27 16:49:15.180441 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 16:49:15.180441 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 16:49:15.180441 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 16:49:15.180441 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 16:49:15.180441 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 27 16:49:15.180441 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 27 16:49:15.180441 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 27 16:49:15.180441 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 27 16:49:15.180441 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 27 16:49:15.180441 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 27 16:49:15.180441 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 27 16:49:15.180441 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 27 16:49:15.181987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 16:49:15.181987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 16:49:15.181987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 16:49:15.181987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 16:49:15.181987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-520800244 could not be found. Sep 27 16:49:15.181987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.181987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:49:15.181987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.181987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:49:15.181987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:49:15.181987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:49:15.181987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:49:15.181987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:49:15.181987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 16:49:15.181987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 16:49:15.181987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:49:15.181987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:49:15.181987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 27 16:49:15.181987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:49:15.181987 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-520800244 could not be found. Sep 27 16:49:15.183612 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.183612 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:49:15.183612 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.183612 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:49:15.183612 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:49:15.183612 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:49:15.183612 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:49:15.183612 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:49:15.183612 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-520800244 could not be found. Sep 27 16:49:15.183612 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.183612 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7aaa77c7-7dea-450b-b4e8-425670756dd4 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] Returning 404 to user: Volume tempest-invalid-520800244 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:49:15.183612 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7aaa77c7-7dea-450b-b4e8-425670756dd4 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/tempest-invalid-520800244" status: 404 len: 98 microversion: 2.1 time: 0.036339 Sep 27 16:49:15.183612 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 611/1171] 10.222.0.64 () {58 vars in 1215 bytes} [Tue Sep 27 16:49:15 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-520800244 => generated 98 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 27 16:49:15.186515 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f92cef2c-3735-4237-8d1f-a70cd719c537 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004210 Sep 27 16:49:15.187044 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 561/1172] 10.222.0.64 () {58 vars in 1140 bytes} [Tue Sep 27 16:49:15 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 27 16:49:15.195216 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-38086761-be80-4746-a745-9cce82f4bea4 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003649 Sep 27 16:49:15.195753 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 612/1173] 10.222.0.64 () {58 vars in 1137 bytes} [Tue Sep 27 16:49:15 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 27 16:49:15.203979 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-afc5f512-4fbd-4fa1-87ec-db6397b2cdb3 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] Calling method '.version_select at 0x7fa405c41430>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:49:15.231456 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-afc5f512-4fbd-4fa1-87ec-db6397b2cdb3 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] HTTP exception thrown: Volume 14ce250e-2509-4144-9383-145491088e8a could not be found. Sep 27 16:49:15.234011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-afc5f512-4fbd-4fa1-87ec-db6397b2cdb3 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] Request method failure captured: Sep 27 16:49:15.234011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/os-volumes/14ce250e-2509-4144-9383-145491088e8a HTTP/1.1 Sep 27 16:49:15.234011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 27 16:49:15.234011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 27 16:49:15.234011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Connection: close Sep 27 16:49:15.234011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 27 16:49:15.234011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 27 16:49:15.234011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Host: 10.222.0.64 Sep 27 16:49:15.234011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 27 16:49:15.234011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 27 16:49:15.234011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjMymKscf7Cu5l5YzUkxEzz00gLxTLWrpDcEqW-RoyfMuq-GLq2ZnzCgr3F1T4tVAs7Yx_LTotopU-OE_Ijw5hPglhvN_9VF2ucKuYLFpdeHIPgZvAGKhXD_9uQpXZyLn9I9a-gxME5jkamGZihz-tf3gVfJRKFOSyq7-zJ0-JFW-TruI Sep 27 16:49:15.234011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 27 16:49:15.234011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 27 16:49:15.234011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 27 16:49:15.234011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 27 16:49:15.234011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 27 16:49:15.234011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 27 16:49:15.234011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Id: 55b3f15fb2714f2cb893a0f4430d9bac Sep 27 16:49:15.234011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesNegativeTest-863838489 Sep 27 16:49:15.234011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Role: reader,member Sep 27 16:49:15.234011 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Roles: reader,member Sep 27 16:49:15.235754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:49:15.235754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesNegativeTest-863838489 Sep 27 16:49:15.235754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 55b3f15fb2714f2cb893a0f4430d9bac Sep 27 16:49:15.235754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesNegativeTest-863838489 Sep 27 16:49:15.235754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesNegativeTest-863838489-project Sep 27 16:49:15.235754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 27 16:49:15.235754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 27 16:49:15.235754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Id: 0eb34e423bd84c8e808a61e8483a68b7 Sep 27 16:49:15.235754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesNegativeTest-863838489-project Sep 27 16:49:15.235754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: method: Sep 27 16:49:15.235754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: exception: Volume 14ce250e-2509-4144-9383-145491088e8a could not be found. Sep 27 16:49:15.235754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: action_args: {'id': '14ce250e-2509-4144-9383-145491088e8a'} Sep 27 16:49:15.235754 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:49:15.236830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:49:15.236830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 16:49:15.236830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 16:49:15.236830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 27 16:49:15.236830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 27 16:49:15.236830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 27 16:49:15.236830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 27 16:49:15.236830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 27 16:49:15.236830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 27 16:49:15.236830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 27 16:49:15.236830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 27 16:49:15.236830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 16:49:15.236830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 16:49:15.236830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 16:49:15.236830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 16:49:15.236830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 14ce250e-2509-4144-9383-145491088e8a could not be found. (HTTP 404) (Request-ID: req-d02efff1-9a2c-466e-8f80-8257c110e88c) Sep 27 16:49:15.236830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.236830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:49:15.236830 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.238298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:49:15.238298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 27 16:49:15.238298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 27 16:49:15.238298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 16:49:15.238298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 16:49:15.238298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 27 16:49:15.238298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 27 16:49:15.238298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 16:49:15.238298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 16:49:15.238298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 16:49:15.238298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 16:49:15.238298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 27 16:49:15.238298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 27 16:49:15.238298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 27 16:49:15.238298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 27 16:49:15.238298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 27 16:49:15.238298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 27 16:49:15.238298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 27 16:49:15.238298 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 27 16:49:15.239883 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 16:49:15.239883 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 16:49:15.239883 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 16:49:15.239883 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 16:49:15.239883 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 14ce250e-2509-4144-9383-145491088e8a could not be found. Sep 27 16:49:15.239883 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.239883 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:49:15.239883 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.239883 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:49:15.239883 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:49:15.239883 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:49:15.239883 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:49:15.239883 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:49:15.239883 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 16:49:15.239883 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 16:49:15.239883 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:49:15.239883 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:49:15.239883 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 27 16:49:15.239883 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:49:15.241422 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 14ce250e-2509-4144-9383-145491088e8a could not be found. Sep 27 16:49:15.241422 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.241422 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:49:15.241422 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.241422 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:49:15.241422 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:49:15.241422 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:49:15.241422 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:49:15.241422 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:49:15.241422 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 14ce250e-2509-4144-9383-145491088e8a could not be found. Sep 27 16:49:15.241422 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.241422 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-afc5f512-4fbd-4fa1-87ec-db6397b2cdb3 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] Returning 404 to user: Volume 14ce250e-2509-4144-9383-145491088e8a could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:49:15.241422 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-afc5f512-4fbd-4fa1-87ec-db6397b2cdb3 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/14ce250e-2509-4144-9383-145491088e8a" status: 404 len: 109 microversion: 2.1 time: 0.035038 Sep 27 16:49:15.241422 dv-cinder-855060-2-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 562/1174] 10.222.0.64 () {58 vars in 1248 bytes} [Tue Sep 27 16:49:15 2022] DELETE /compute/v2.1/os-volumes/14ce250e-2509-4144-9383-145491088e8a => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 16:49:15.245297 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3a132801-61e8-47f7-8647-f88df70ae1d8 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] Calling method '.version_select at 0x7fa4090c33a0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 16:49:15.273206 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-3a132801-61e8-47f7-8647-f88df70ae1d8 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] HTTP exception thrown: Volume ec97e3fb-3de8-4e7b-9043-506b9dcf1965 could not be found. Sep 27 16:49:15.275226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3a132801-61e8-47f7-8647-f88df70ae1d8 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] Request method failure captured: Sep 27 16:49:15.275226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/os-volumes/ec97e3fb-3de8-4e7b-9043-506b9dcf1965 HTTP/1.1 Sep 27 16:49:15.275226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 27 16:49:15.275226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 27 16:49:15.275226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Connection: close Sep 27 16:49:15.275226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 27 16:49:15.275226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 27 16:49:15.275226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Host: 10.222.0.64 Sep 27 16:49:15.275226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 27 16:49:15.275226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 27 16:49:15.275226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjMymKscf7Cu5l5YzUkxEzz00gLxTLWrpDcEqW-RoyfMuq-GLq2ZnzCgr3F1T4tVAs7Yx_LTotopU-OE_Ijw5hPglhvN_9VF2ucKuYLFpdeHIPgZvAGKhXD_9uQpXZyLn9I9a-gxME5jkamGZihz-tf3gVfJRKFOSyq7-zJ0-JFW-TruI Sep 27 16:49:15.275226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 27 16:49:15.275226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 27 16:49:15.275226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 27 16:49:15.275226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 27 16:49:15.275226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 27 16:49:15.275226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 27 16:49:15.275226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Id: 55b3f15fb2714f2cb893a0f4430d9bac Sep 27 16:49:15.275226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesNegativeTest-863838489 Sep 27 16:49:15.275226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Role: reader,member Sep 27 16:49:15.275226 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Roles: reader,member Sep 27 16:49:15.277092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/55b3f15fb2714f2cb893a0f4430d9bac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}] Sep 27 16:49:15.277092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesNegativeTest-863838489 Sep 27 16:49:15.277092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 55b3f15fb2714f2cb893a0f4430d9bac Sep 27 16:49:15.277092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesNegativeTest-863838489 Sep 27 16:49:15.277092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesNegativeTest-863838489-project Sep 27 16:49:15.277092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 27 16:49:15.277092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 27 16:49:15.277092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Id: 0eb34e423bd84c8e808a61e8483a68b7 Sep 27 16:49:15.277092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesNegativeTest-863838489-project Sep 27 16:49:15.277092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: method: Sep 27 16:49:15.277092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: exception: Volume ec97e3fb-3de8-4e7b-9043-506b9dcf1965 could not be found. Sep 27 16:49:15.277092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: action_args: {'id': 'ec97e3fb-3de8-4e7b-9043-506b9dcf1965'} Sep 27 16:49:15.277092 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 16:49:15.278281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:49:15.278281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 16:49:15.278281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 16:49:15.278281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 16:49:15.278281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 16:49:15.278281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 16:49:15.278281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 16:49:15.278281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 16:49:15.278281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 16:49:15.278281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 16:49:15.278281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 16:49:15.278281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 16:49:15.278281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 16:49:15.278281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 16:49:15.278281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 16:49:15.278281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ec97e3fb-3de8-4e7b-9043-506b9dcf1965 could not be found. (HTTP 404) (Request-ID: req-78a11e57-0f9a-499e-8ac2-267c5bee4d5e) Sep 27 16:49:15.278281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.278281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:49:15.278281 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.280685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:49:15.280685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 27 16:49:15.280685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 27 16:49:15.280685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 16:49:15.280685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 16:49:15.280685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 27 16:49:15.280685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 27 16:49:15.280685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 16:49:15.280685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 16:49:15.280685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 16:49:15.280685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 16:49:15.280685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 16:49:15.280685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 16:49:15.280685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 16:49:15.280685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 16:49:15.280685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 16:49:15.280685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 16:49:15.280685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 16:49:15.280685 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 16:49:15.282192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 16:49:15.282192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 16:49:15.282192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 16:49:15.282192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 16:49:15.282192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ec97e3fb-3de8-4e7b-9043-506b9dcf1965 could not be found. Sep 27 16:49:15.282192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.282192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:49:15.282192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.282192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:49:15.282192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:49:15.282192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:49:15.282192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 16:49:15.282192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 16:49:15.282192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 16:49:15.282192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 16:49:15.282192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 16:49:15.282192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 16:49:15.282192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 27 16:49:15.282192 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 16:49:15.283750 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ec97e3fb-3de8-4e7b-9043-506b9dcf1965 could not be found. Sep 27 16:49:15.283750 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.283750 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 16:49:15.283750 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.283750 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 16:49:15.283750 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 16:49:15.283750 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 16:49:15.283750 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 16:49:15.283750 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 16:49:15.283750 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ec97e3fb-3de8-4e7b-9043-506b9dcf1965 could not be found. Sep 27 16:49:15.283750 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 27 16:49:15.283750 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3a132801-61e8-47f7-8647-f88df70ae1d8 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] Returning 404 to user: Volume ec97e3fb-3de8-4e7b-9043-506b9dcf1965 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 16:49:15.283750 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3a132801-61e8-47f7-8647-f88df70ae1d8 tempest-VolumesNegativeTest-863838489 tempest-VolumesNegativeTest-863838489-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ec97e3fb-3de8-4e7b-9043-506b9dcf1965" status: 404 len: 109 microversion: 2.1 time: 0.035051 Sep 27 16:49:15.283750 dv-cinder-855060-2-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 613/1175] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Sep 27 16:49:15 2022] GET /compute/v2.1/os-volumes/ec97e3fb-3de8-4e7b-9043-506b9dcf1965 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)